Apr 13 17:39:25 user devstack@n-api.service[61675]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 13 17:39:25 user devstack@n-api.service[61675]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 13 17:39:25 2023] *** Apr 13 17:39:25 user devstack@n-api.service[61675]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 13 17:39:25 user devstack@n-api.service[61675]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 13 17:39:25 user devstack@n-api.service[61675]: nodename: user Apr 13 17:39:25 user devstack@n-api.service[61675]: machine: x86_64 Apr 13 17:39:25 user devstack@n-api.service[61675]: clock source: unix Apr 13 17:39:25 user devstack@n-api.service[61675]: pcre jit disabled Apr 13 17:39:25 user devstack@n-api.service[61675]: detected number of CPU cores: 12 Apr 13 17:39:25 user devstack@n-api.service[61675]: current working directory: / Apr 13 17:39:25 user devstack@n-api.service[61675]: detected binary path: /usr/bin/uwsgi-core Apr 13 17:39:25 user devstack@n-api.service[61675]: your processes number limit is 63637 Apr 13 17:39:25 user devstack@n-api.service[61675]: your memory page size is 4096 bytes Apr 13 17:39:25 user devstack@n-api.service[61675]: detected max file descriptor number: 2048 Apr 13 17:39:25 user devstack@n-api.service[61675]: lock engine: pthread robust mutexes Apr 13 17:39:25 user devstack@n-api.service[61675]: thunder lock: enabled Apr 13 17:39:25 user devstack@n-api.service[61675]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 13 17:39:25 user devstack@n-api.service[61675]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 13 17:39:25 user devstack@n-api.service[61675]: Python main interpreter initialized at 0x5636273a8990 Apr 13 17:39:25 user devstack@n-api.service[61675]: python threads support enabled Apr 13 17:39:25 user devstack@n-api.service[61675]: your server socket listen backlog is limited to 100 connections Apr 13 17:39:25 user devstack@n-api.service[61675]: your mercy for graceful operations on workers is 90 seconds Apr 13 17:39:25 user devstack@n-api.service[61675]: mapped 537436 bytes (524 KB) for 3 cores Apr 13 17:39:25 user devstack@n-api.service[61675]: *** Operational MODE: preforking *** Apr 13 17:39:25 user devstack@n-api.service[61675]: *** uWSGI is running in multiple interpreter mode *** Apr 13 17:39:25 user devstack@n-api.service[61675]: spawned uWSGI master process (pid: 61675) Apr 13 17:39:25 user devstack@n-api.service[61675]: spawned uWSGI worker 1 (pid: 61676, cores: 1) Apr 13 17:39:25 user devstack@n-api.service[61675]: spawned uWSGI worker 2 (pid: 61677, cores: 1) Apr 13 17:39:25 user devstack@n-api.service[61675]: spawned uWSGI worker 3 (pid: 61678, cores: 1) Apr 13 17:39:25 user devstack@n-api.service[61675]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 13 17:39:26 user devstack@n-api.service[61678]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 17:39:26 user devstack@n-api.service[61677]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 17:39:26 user devstack@n-api.service[61676]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 17:39:29 user devstack@n-api.service[61678]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 17:39:29 user devstack@n-api.service[61678]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 17:39:29 user devstack@n-api.service[61678]: and ``live_migration_inbound_addr`` respectively. Apr 13 17:39:29 user devstack@n-api.service[61678]: ). Its value may be silently ignored in the future. Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 17:39:30 user devstack@n-api.service[61676]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 17:39:30 user devstack@n-api.service[61676]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 17:39:30 user devstack@n-api.service[61676]: and ``live_migration_inbound_addr`` respectively. Apr 13 17:39:30 user devstack@n-api.service[61676]: ). Its value may be silently ignored in the future. Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 17:39:30 user devstack@n-api.service[61677]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 17:39:30 user devstack@n-api.service[61677]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 17:39:30 user devstack@n-api.service[61677]: and ``live_migration_inbound_addr`` respectively. Apr 13 17:39:30 user devstack@n-api.service[61677]: ). Its value may be silently ignored in the future. Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61678) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61676) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61677) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 17:39:30 user devstack@n-api.service[61678]: INFO dbcounter [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Registered counter for database nova_api Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_db.sqlalchemy.engines [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61678) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writer thread running {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61676]: INFO dbcounter [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Registered counter for database nova_api Apr 13 17:39:30 user devstack@n-api.service[61677]: INFO dbcounter [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Registered counter for database nova_api Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61676) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writer thread running {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.context [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e058663-3c31-4a79-958e-63202e338bb0(cell1) {{(pid=61678) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_db.sqlalchemy.engines [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61677) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writer thread running {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61678]: INFO dbcounter [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Registered counter for database nova_cell0 Apr 13 17:39:30 user devstack@n-api.service[61678]: INFO dbcounter [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Registered counter for database nova_cell1 Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_db.sqlalchemy.engines [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61678) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_db.sqlalchemy.engines [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61678) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writer thread running {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writer thread running {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG nova.context [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e058663-3c31-4a79-958e-63202e338bb0(cell1) {{(pid=61676) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG nova.context [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e058663-3c31-4a79-958e-63202e338bb0(cell1) {{(pid=61677) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:39:30 user devstack@n-api.service[61676]: INFO dbcounter [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Registered counter for database nova_cell0 Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:39:30 user devstack@n-api.service[61676]: INFO dbcounter [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Registered counter for database nova_cell1 Apr 13 17:39:30 user devstack@n-api.service[61677]: INFO dbcounter [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Registered counter for database nova_cell0 Apr 13 17:39:30 user devstack@n-api.service[61677]: INFO dbcounter [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Registered counter for database nova_cell1 Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61676) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writer thread running {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_db.sqlalchemy.engines [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61677) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writer thread running {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_db.sqlalchemy.engines [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61677) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61678]: INFO dbcounter [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Registered counter for database nova_cell0 Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG oslo_db.sqlalchemy.engines [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61678) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writer thread running {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61676) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writer thread running {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61676]: INFO dbcounter [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Registered counter for database nova_cell0 Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61676) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writer thread running {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writer thread running {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61677]: INFO dbcounter [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Registered counter for database nova_cell0 Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG oslo_db.sqlalchemy.engines [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61677) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 17:39:30 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writer thread running {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 17:39:30 user devstack@n-api.service[61676]: WARNING keystonemiddleware.auth_token [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 17:39:30 user devstack@n-api.service[61676]: WARNING keystonemiddleware.auth_token [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 17:39:30 user devstack@n-api.service[61678]: WARNING keystonemiddleware.auth_token [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 17:39:30 user devstack@n-api.service[61678]: WARNING keystonemiddleware.auth_token [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 17:39:30 user devstack@n-api.service[61678]: WARNING keystonemiddleware.auth_token [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 17:39:30 user devstack@n-api.service[61678]: WARNING keystonemiddleware.auth_token [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 17:39:30 user devstack@n-api.service[61678]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636273a8990 pid: 61678 (default app) Apr 13 17:39:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:39:30 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001502 Apr 13 17:39:30 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 13 17:39:30 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:39:30 user devstack@n-api.service[61677]: WARNING keystonemiddleware.auth_token [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 17:39:30 user devstack@n-api.service[61677]: WARNING keystonemiddleware.auth_token [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 17:39:31 user devstack@n-api.service[61676]: WARNING keystonemiddleware.auth_token [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 17:39:31 user devstack@n-api.service[61676]: WARNING keystonemiddleware.auth_token [None req-1ab40be2-51a9-4b97-abf2-225d07cade09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 17:39:31 user devstack@n-api.service[61676]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636273a8990 pid: 61676 (default app) Apr 13 17:39:31 user devstack@n-api.service[61677]: WARNING keystonemiddleware.auth_token [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 17:39:31 user devstack@n-api.service[61677]: WARNING keystonemiddleware.auth_token [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 17:39:31 user devstack@n-api.service[61677]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636273a8990 pid: 61677 (default app) Apr 13 17:41:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-8d5af4ed-3366-44cb-9eba-2923816f6869 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001502 Apr 13 17:41:40 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-7fee7618-5f9d-4e37-855c-eb01730dd849 admin admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-7fee7618-5f9d-4e37-855c-eb01730dd849 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.453403 Apr 13 17:41:41 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 17:41:40 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:41:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002849 Apr 13 17:41:42 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:42 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9b5252b6-7c4e-4b0b-b236-d457a8c4e80e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 256}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9b5252b6-7c4e-4b0b-b236-d457a8c4e80e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.353220 Apr 13 17:41:43 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:41:42 2023] POST /compute/v2.1/flavors => generated 405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:41:43 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6d486d56-6cf3-4d7d-a4f8-31750e297621 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:43 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-6d486d56-6cf3-4d7d-a4f8-31750e297621 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055614 Apr 13 17:41:43 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 17:41:43 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:41:45 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:45 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001374 Apr 13 17:41:45 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:45 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:45 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5848b2c8-6afb-4a5d-b7c0-0836494a56c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5848b2c8-6afb-4a5d-b7c0-0836494a56c4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058109 Apr 13 17:41:45 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:41:45 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:41:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0cef2d73-3a63-4159-8d36-1b24e273c077 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0cef2d73-3a63-4159-8d36-1b24e273c077 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026557 Apr 13 17:41:45 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 17:41:45 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:41:47 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001757 Apr 13 17:41:47 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:47 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5481e0c6-3764-4a16-b25e-23d3d083b22a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5481e0c6-3764-4a16-b25e-23d3d083b22a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067233 Apr 13 17:41:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:41:47 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:41:47 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-11abb031-d0c9-46f4-be66-b559c3e5b8bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:47 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-11abb031-d0c9-46f4-be66-b559c3e5b8bf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030734 Apr 13 17:41:47 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 17:41:47 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:41:49 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001360 Apr 13 17:41:49 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:49 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:49 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7b135e33-5ea3-4691-86a1-0e24e356db9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7b135e33-5ea3-4691-86a1-0e24e356db9e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058061 Apr 13 17:41:49 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:41:49 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:41:49 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6985e2d2-7b9e-4ff9-aceb-eb313cec600c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:49 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-6985e2d2-7b9e-4ff9-aceb-eb313cec600c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026046 Apr 13 17:41:49 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 17:41:49 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:41:51 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:51 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001433 Apr 13 17:41:51 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:51 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-b76cee5d-8ae3-47e6-88cc-a5599e43cf1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-b76cee5d-8ae3-47e6-88cc-a5599e43cf1b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065703 Apr 13 17:41:51 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:41:51 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:41:51 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:51 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024288 Apr 13 17:41:51 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 17:41:51 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:41:53 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f3b7693d-2db1-42be-8f49-54af3abe875b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002380 Apr 13 17:41:53 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:53 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:53 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7fcb279e-7cd1-4566-9acf-9eb3a3a8f3bd admin admin] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:53 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7fcb279e-7cd1-4566-9acf-9eb3a3a8f3bd admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.073101 Apr 13 17:41:53 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 17:41:53 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:41:55 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001479 Apr 13 17:41:55 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:55 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:55 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:55 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:55 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:55 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:41:55 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f22c494d-cfd3-4f4b-b297-06616c60a394 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f22c494d-cfd3-4f4b-b297-06616c60a394 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.324291 Apr 13 17:41:55 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:41:55 2023] POST /compute/v2.1/flavors => generated 400 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:41:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7c85d261-b09f-46a7-96c4-b32f61313419 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7c85d261-b09f-46a7-96c4-b32f61313419 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043767 Apr 13 17:41:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 17:41:55 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:41:57 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:57 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001885 Apr 13 17:41:57 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:57 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:57 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8beb8192-0d47-4166-9928-a03edaff9eee admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "ram": 2048, "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:57 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8beb8192-0d47-4166-9928-a03edaff9eee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.069502 Apr 13 17:41:57 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:41:57 2023] POST /compute/v2.1/flavors => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:41:57 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ef150972-de75-4380-88c5-6cf3cfb615f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:57 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ef150972-de75-4380-88c5-6cf3cfb615f4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031877 Apr 13 17:41:57 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 17:41:57 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:41:59 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:41:59 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001310 Apr 13 17:41:59 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:41:59 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:41:59 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3c9d6faf-0a0d-4006-aacf-d9c96f8c3947 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:59 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3c9d6faf-0a0d-4006-aacf-d9c96f8c3947 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.060095 Apr 13 17:41:59 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:41:59 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:41:59 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-22925df3-e058-42aa-a123-3d967581adc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:41:59 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-22925df3-e058-42aa-a123-3d967581adc6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030379 Apr 13 17:41:59 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 17:41:59 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:42:01 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:42:01 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001445 Apr 13 17:42:01 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:42:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:42:01 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3374ff4c-9bce-4639-816f-db5dffba424f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "ram": 8192, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:42:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3374ff4c-9bce-4639-816f-db5dffba424f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.071416 Apr 13 17:42:01 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:42:01 2023] POST /compute/v2.1/flavors => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:42:01 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7a01a531-9952-4a71-8c7c-8c1a976a26b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:42:01 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7a01a531-9952-4a71-8c7c-8c1a976a26b3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034911 Apr 13 17:42:01 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 17:42:01 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:42:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:42:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002598 Apr 13 17:42:03 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 17:42:03 2023] GET /compute/v2.1 => generated 387 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:42:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-423eaa68-1868-4a97-8123-d249d8306d10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "ram": 16384, "rxtx_factor": 1.0}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:42:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-423eaa68-1868-4a97-8123-d249d8306d10 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070105 Apr 13 17:42:03 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 17:42:03 2023] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:42:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-32f6948e-7666-4493-bbde-99c33332f7f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:42:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-32f6948e-7666-4493-bbde-99c33332f7f6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027795 Apr 13 17:42:03 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 17:42:03 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:42:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:42:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f08f16ab-c49b-47f3-8e4e-3b29c33f62b6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.005600 Apr 13 17:42:35 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 17:42:35 2023] GET /compute/v2.1 => generated 387 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:42:35 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:42:35 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:42:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:42:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:42:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:42:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:42:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:42:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:42:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.092198 Apr 13 17:42:35 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 13 17:42:35 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:43:07 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-32f6948e-7666-4493-bbde-99c33332f7f6 admin admin] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:43:07 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-32f6948e-7666-4493-bbde-99c33332f7f6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003566 Apr 13 17:43:07 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 17:43:07 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:43:07 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:43:07 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-cabe6af0-7982-47f2-a22e-d93e03dad6db admin admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:43:07 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-cabe6af0-7982-47f2-a22e-d93e03dad6db admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.077111 Apr 13 17:43:07 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 13 17:43:07 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:43:11 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:43:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001446 Apr 13 17:43:11 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 17:43:11 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:43:11 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:43:11 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-01b07863-e77c-44c5-a8d1-9fa9ab244825 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "42", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.nano", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 128, "swap": 0, "disk": 1}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:43:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-01b07863-e77c-44c5-a8d1-9fa9ab244825 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061982 Apr 13 17:43:11 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 17:43:11 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:43:11 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-fc1e6d0e-2db0-4ca3-a9dd-66a6f8712f71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:43:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-fc1e6d0e-2db0-4ca3-a9dd-66a6f8712f71 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028351 Apr 13 17:43:11 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 17:43:11 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:43:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:43:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9c313ba9-23fc-4a7f-ace3-1eda452ad1af admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002265 Apr 13 17:43:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 17:43:16 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:43:16 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ab894e31-5755-4966-a922-60d05118ab8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "84", "name": "m1.micro", "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 192, "os-flavor-access:is_public": true}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:43:16 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ab894e31-5755-4966-a922-60d05118ab8a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.065686 Apr 13 17:43:16 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 17:43:16 2023] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:43:16 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-344abd51-e7e1-4c33-a70a-4f366ad5a890 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:43:16 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-344abd51-e7e1-4c33-a70a-4f366ad5a890 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026915 Apr 13 17:43:16 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 17:43:16 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:45:29 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:45:29 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:45:29 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:45:29 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:45:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7f1f914d-edfd-4fd9-876d-bc54da3101aa tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Action: 'create', calling method: .version_select at 0x7f82e347da20>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1032556788", "metadata": {"Type": "work"}}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:45:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7f1f914d-edfd-4fd9-876d-bc54da3101aa tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Request method failure captured: Apr 13 17:45:29 user devstack@n-api.service[61677]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 17:45:29 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:45:29 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:45:29 user devstack@n-api.service[61677]: Connection: close Apr 13 17:45:29 user devstack@n-api.service[61677]: Content-Length: 122 Apr 13 17:45:29 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:45:29 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:45:29 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:45:29 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD-4J56h9rs88H09YXuSkB9y3LI2EJy2bwIM3Hd-IZuBBR3NfeIVbdGROs9OcaoO4cg3eD7TnHKxj3cNk-LOtQClr39DiO87no0mwB1pNCvSR8noeKFgW1jryFRWG54dpD_5ApYMJ8USPUCEpZuZq6o8NSphIUZL2272fMfDbxJ06XI Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Project-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Project-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Tenant: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Tenant-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User-Id: 47099d33244542afbe4bb46bc58ffa56 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User-Name: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:29 user devstack@n-api.service[61677]: Apr 13 17:45:29 user devstack@n-api.service[61677]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1032556788", "metadata": {"Type": "work"}}} Apr 13 17:45:29 user devstack@n-api.service[61677]: method: Apr 13 17:45:29 user devstack@n-api.service[61677]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 17:45:29 user devstack@n-api.service[61677]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1032556788', 'metadata': {'Type': 'work'}}}} Apr 13 17:45:29 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise error Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi '#$%' Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7f1f914d-edfd-4fd9-876d-bc54da3101aa tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:45:29 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-7f1f914d-edfd-4fd9-876d-bc54da3101aa tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.428989 Apr 13 17:45:29 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 17:45:29 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 430 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:45:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1025126a-9399-424b-aa10-a56d2f66a99b tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Action: 'create', calling method: .version_select at 0x7f82e36a3b50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1404671387", "metadata": {"Type": "work"}}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:45:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-27188b1b-c938-4234-aab7-ea9e6e942412 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Action: 'create', calling method: .version_select at 0x7f82e3482710>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1204633281", "metadata": {"Type": "work"}}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:45:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1025126a-9399-424b-aa10-a56d2f66a99b tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Request method failure captured: Apr 13 17:45:29 user devstack@n-api.service[61676]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 17:45:29 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:45:29 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:45:29 user devstack@n-api.service[61676]: Connection: close Apr 13 17:45:29 user devstack@n-api.service[61676]: Content-Length: 120 Apr 13 17:45:29 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:45:29 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:45:29 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:45:29 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD-4J56h9rs88H09YXuSkB9y3LI2EJy2bwIM3Hd-IZuBBR3NfeIVbdGROs9OcaoO4cg3eD7TnHKxj3cNk-LOtQClr39DiO87no0mwB1pNCvSR8noeKFgW1jryFRWG54dpD_5ApYMJ8USPUCEpZuZq6o8NSphIUZL2272fMfDbxJ06XI Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Project-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Project-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Tenant: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Tenant-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:29 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:29 user devstack@n-api.service[61676]: X-User: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:29 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:45:29 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:45:29 user devstack@n-api.service[61676]: X-User-Id: 47099d33244542afbe4bb46bc58ffa56 Apr 13 17:45:29 user devstack@n-api.service[61676]: X-User-Name: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:29 user devstack@n-api.service[61676]: Apr 13 17:45:29 user devstack@n-api.service[61676]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1404671387", "metadata": {"Type": "work"}}} Apr 13 17:45:29 user devstack@n-api.service[61676]: method: Apr 13 17:45:29 user devstack@n-api.service[61676]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 17:45:29 user devstack@n-api.service[61676]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1404671387', 'metadata': {'Type': 'work'}}}} Apr 13 17:45:29 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise error Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi '0' Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 17:45:29 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1025126a-9399-424b-aa10-a56d2f66a99b tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:45:29 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1025126a-9399-424b-aa10-a56d2f66a99b tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014482 Apr 13 17:45:29 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 16/47] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 17:45:29 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:45:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8342394f-b992-414c-97b0-4576d7281512 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Action: 'create', calling method: .version_select at 0x7f82e34c0dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-815326721", "metadata": {"Type": "work"}}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:45:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8342394f-b992-414c-97b0-4576d7281512 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Request method failure captured: Apr 13 17:45:29 user devstack@n-api.service[61677]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 17:45:29 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:45:29 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:45:29 user devstack@n-api.service[61677]: Connection: close Apr 13 17:45:29 user devstack@n-api.service[61677]: Content-Length: 118 Apr 13 17:45:29 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:45:29 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:45:29 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:45:29 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD-4J56h9rs88H09YXuSkB9y3LI2EJy2bwIM3Hd-IZuBBR3NfeIVbdGROs9OcaoO4cg3eD7TnHKxj3cNk-LOtQClr39DiO87no0mwB1pNCvSR8noeKFgW1jryFRWG54dpD_5ApYMJ8USPUCEpZuZq6o8NSphIUZL2272fMfDbxJ06XI Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Project-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Project-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Tenant: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Tenant-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User-Id: 47099d33244542afbe4bb46bc58ffa56 Apr 13 17:45:29 user devstack@n-api.service[61677]: X-User-Name: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:29 user devstack@n-api.service[61677]: Apr 13 17:45:29 user devstack@n-api.service[61677]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-815326721", "metadata": {"Type": "work"}}} Apr 13 17:45:29 user devstack@n-api.service[61677]: method: Apr 13 17:45:29 user devstack@n-api.service[61677]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 17:45:29 user devstack@n-api.service[61677]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-815326721', 'metadata': {'Type': 'work'}}}} Apr 13 17:45:29 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise error Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi '' Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 17:45:29 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8342394f-b992-414c-97b0-4576d7281512 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:45:29 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8342394f-b992-414c-97b0-4576d7281512 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008315 Apr 13 17:45:29 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 17:45:29 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:45:29 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:45:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3efbc39d-370e-4452-a584-02fa4fa27757 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Calling method '.version_select at 0x7f82e3bf3250>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-3efbc39d-370e-4452-a584-02fa4fa27757 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] HTTP exception thrown: Volume tempest-invalid-368242251 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3efbc39d-370e-4452-a584-02fa4fa27757 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Request method failure captured: Apr 13 17:45:30 user devstack@n-api.service[61676]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-368242251 HTTP/1.1 Apr 13 17:45:30 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:45:30 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:45:30 user devstack@n-api.service[61676]: Connection: close Apr 13 17:45:30 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:45:30 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:45:30 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:45:30 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:45:30 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD-4J56h9rs88H09YXuSkB9y3LI2EJy2bwIM3Hd-IZuBBR3NfeIVbdGROs9OcaoO4cg3eD7TnHKxj3cNk-LOtQClr39DiO87no0mwB1pNCvSR8noeKFgW1jryFRWG54dpD_5ApYMJ8USPUCEpZuZq6o8NSphIUZL2272fMfDbxJ06XI Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Project-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Project-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Tenant: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Tenant-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:30 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:30 user devstack@n-api.service[61676]: X-User: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:30 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:45:30 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:45:30 user devstack@n-api.service[61676]: X-User-Id: 47099d33244542afbe4bb46bc58ffa56 Apr 13 17:45:30 user devstack@n-api.service[61676]: X-User-Name: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:30 user devstack@n-api.service[61676]: method: Apr 13 17:45:30 user devstack@n-api.service[61676]: exception: Volume tempest-invalid-368242251 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61676]: action_args: {'id': 'tempest-invalid-368242251'} Apr 13 17:45:30 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-368242251 could not be found. (HTTP 404) (Request-ID: req-63f08539-c3d4-4507-adba-78837b861d71) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-368242251 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-368242251 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-368242251 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3efbc39d-370e-4452-a584-02fa4fa27757 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Returning 404 to user: Volume tempest-invalid-368242251 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:45:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-3efbc39d-370e-4452-a584-02fa4fa27757 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-368242251" status: 404 len: 98 microversion: 2.1 time: 1.048438 Apr 13 17:45:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 17/49] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 13 17:45:29 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-368242251 => generated 98 bytes in 1051 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 13 17:45:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-6f6919d2-8f9a-4c9f-a864-2f03b3bfb02a tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003449 Apr 13 17:45:30 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 17:45:30 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 17:45:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-84c68153-6e28-4b2e-922f-b2e86d647367 tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005654 Apr 13 17:45:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 18/51] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 13 17:45:30 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 17:45:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-5fb0aa80-50b0-4910-abd8-05cc4f64054f tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Calling method '.version_select at 0x7f82e347d750>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:30 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-27188b1b-c938-4234-aab7-ea9e6e942412 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.696102 Apr 13 17:45:30 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 17:45:29 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 1698 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 17:45:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-d1bc510e-2bac-4774-8abd-5306459c5683 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e33a3f40>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-5fb0aa80-50b0-4910-abd8-05cc4f64054f tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] HTTP exception thrown: Volume 27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-5fb0aa80-50b0-4910-abd8-05cc4f64054f tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Request method failure captured: Apr 13 17:45:30 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/os-volumes/27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7 HTTP/1.1 Apr 13 17:45:30 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:45:30 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:45:30 user devstack@n-api.service[61677]: Connection: close Apr 13 17:45:30 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:45:30 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:45:30 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:45:30 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:45:30 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD-4J56h9rs88H09YXuSkB9y3LI2EJy2bwIM3Hd-IZuBBR3NfeIVbdGROs9OcaoO4cg3eD7TnHKxj3cNk-LOtQClr39DiO87no0mwB1pNCvSR8noeKFgW1jryFRWG54dpD_5ApYMJ8USPUCEpZuZq6o8NSphIUZL2272fMfDbxJ06XI Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Project-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Project-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Tenant: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Tenant-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:30 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:30 user devstack@n-api.service[61677]: X-User: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:30 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:45:30 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:45:30 user devstack@n-api.service[61677]: X-User-Id: 47099d33244542afbe4bb46bc58ffa56 Apr 13 17:45:30 user devstack@n-api.service[61677]: X-User-Name: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:30 user devstack@n-api.service[61677]: method: Apr 13 17:45:30 user devstack@n-api.service[61677]: exception: Volume 27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61677]: action_args: {'id': '27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7'} Apr 13 17:45:30 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7 could not be found. (HTTP 404) (Request-ID: req-fc8c5af8-9de7-45b2-a6dc-18845c1b291a) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-5fb0aa80-50b0-4910-abd8-05cc4f64054f tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Returning 404 to user: Volume 27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:45:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-5fb0aa80-50b0-4910-abd8-05cc4f64054f tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7" status: 404 len: 109 microversion: 2.1 time: 0.346707 Apr 13 17:45:30 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 18/53] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 17:45:30 2023] DELETE /compute/v2.1/os-volumes/27ed1c7d-f99c-418f-9a6b-0f6c63b4eca7 => generated 109 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 17:45:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-022824fb-10c2-49aa-8e20-e218f1fa053e tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Calling method '.version_select at 0x7f82e33037f0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-d1bc510e-2bac-4774-8abd-5306459c5683 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 200 len: 353 microversion: 2.1 time: 0.070960 Apr 13 17:45:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 19/54] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:30 2023] GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:45:30 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-022824fb-10c2-49aa-8e20-e218f1fa053e tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] HTTP exception thrown: Volume f8b5ec2d-d705-419c-bdbc-7d0fb63c6397 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-022824fb-10c2-49aa-8e20-e218f1fa053e tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Request method failure captured: Apr 13 17:45:30 user devstack@n-api.service[61678]: request: GET /compute/v2.1/os-volumes/f8b5ec2d-d705-419c-bdbc-7d0fb63c6397 HTTP/1.1 Apr 13 17:45:30 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:45:30 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:45:30 user devstack@n-api.service[61678]: Connection: close Apr 13 17:45:30 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:45:30 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:45:30 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:45:30 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:45:30 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD-4J56h9rs88H09YXuSkB9y3LI2EJy2bwIM3Hd-IZuBBR3NfeIVbdGROs9OcaoO4cg3eD7TnHKxj3cNk-LOtQClr39DiO87no0mwB1pNCvSR8noeKFgW1jryFRWG54dpD_5ApYMJ8USPUCEpZuZq6o8NSphIUZL2272fMfDbxJ06XI Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Project-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Project-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/080bb37fbea44b5ab1061afd1cc2b4d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Tenant: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Tenant-Id: 080bb37fbea44b5ab1061afd1cc2b4d8 Apr 13 17:45:30 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-VolumesNegativeTest-1166558130 Apr 13 17:45:30 user devstack@n-api.service[61678]: X-User: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:30 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:45:30 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:45:30 user devstack@n-api.service[61678]: X-User-Id: 47099d33244542afbe4bb46bc58ffa56 Apr 13 17:45:30 user devstack@n-api.service[61678]: X-User-Name: tempest-VolumesNegativeTest-1166558130-project-member Apr 13 17:45:30 user devstack@n-api.service[61678]: method: Apr 13 17:45:30 user devstack@n-api.service[61678]: exception: Volume f8b5ec2d-d705-419c-bdbc-7d0fb63c6397 could not be found. Apr 13 17:45:30 user devstack@n-api.service[61678]: action_args: {'id': 'f8b5ec2d-d705-419c-bdbc-7d0fb63c6397'} Apr 13 17:45:30 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8b5ec2d-d705-419c-bdbc-7d0fb63c6397 could not be found. (HTTP 404) (Request-ID: req-144aa2b6-111c-4d0f-b5ae-82f403baefc9) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:45:30 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8b5ec2d-d705-419c-bdbc-7d0fb63c6397 could not be found. Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8b5ec2d-d705-419c-bdbc-7d0fb63c6397 could not be found. Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8b5ec2d-d705-419c-bdbc-7d0fb63c6397 could not be found. Apr 13 17:45:31 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:31 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-022824fb-10c2-49aa-8e20-e218f1fa053e tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] Returning 404 to user: Volume f8b5ec2d-d705-419c-bdbc-7d0fb63c6397 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:45:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-022824fb-10c2-49aa-8e20-e218f1fa053e tempest-VolumesNegativeTest-1166558130 tempest-VolumesNegativeTest-1166558130-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f8b5ec2d-d705-419c-bdbc-7d0fb63c6397" status: 404 len: 109 microversion: 2.1 time: 0.045898 Apr 13 17:45:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:30 2023] GET /compute/v2.1/os-volumes/f8b5ec2d-d705-419c-bdbc-7d0fb63c6397 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:45:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a2049617-235e-4ba2-a044-cbc5493e40bf tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e347fd90>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a2049617-235e-4ba2-a044-cbc5493e40bf tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 200 len: 353 microversion: 2.1 time: 0.088247 Apr 13 17:45:32 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 19/56] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:31 2023] GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:45:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a78d2e06-123e-47f3-8663-44d34c788a8f tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e33a39a0>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a78d2e06-123e-47f3-8663-44d34c788a8f tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 200 len: 354 microversion: 2.1 time: 0.071220 Apr 13 17:45:33 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 20/57] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:33 2023] GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:45:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-4e78c113-df9b-486b-b04b-33b2f2aa5218 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e3354f70>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-4e78c113-df9b-486b-b04b-33b2f2aa5218 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 200 len: 354 microversion: 2.1 time: 0.052494 Apr 13 17:45:33 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:33 2023] GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:45:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-c15eadcf-aab9-44d6-8419-b4aa3fbbda27 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e334a440>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:33 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-c15eadcf-aab9-44d6-8419-b4aa3fbbda27 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 202 len: 0 microversion: 2.1 time: 0.122514 Apr 13 17:45:33 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 20/59] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 17:45:33 2023] DELETE /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:45:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-d75edd8c-8ce8-4961-9cbc-a47bbd65c7c2 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e34cd510>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-d75edd8c-8ce8-4961-9cbc-a47bbd65c7c2 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 200 len: 353 microversion: 2.1 time: 0.066113 Apr 13 17:45:33 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 21/60] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:33 2023] GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:45:34 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ec42deae-ff85-4481-b3f8-b6ab913957fc tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e33556c0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:34 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ec42deae-ff85-4481-b3f8-b6ab913957fc tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 200 len: 353 microversion: 2.1 time: 0.066090 Apr 13 17:45:34 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:34 2023] GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:45:35 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8807a6f3-69cd-40c8-b2c8-0bd7970648da tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e334ab00>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8807a6f3-69cd-40c8-b2c8-0bd7970648da tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 200 len: 353 microversion: 2.1 time: 0.050078 Apr 13 17:45:35 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 21/62] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:35 2023] GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:45:36 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-fd9a8c68-f8f0-4015-a029-c7d35f2b4889 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e3208670>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:36 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-fd9a8c68-f8f0-4015-a029-c7d35f2b4889 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 200 len: 353 microversion: 2.1 time: 0.046032 Apr 13 17:45:36 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 22/63] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:36 2023] GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 353 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:45:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-a712d646-b036-4013-a798-87659d2a5a70 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Calling method '.version_select at 0x7f82e3355750>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-a712d646-b036-4013-a798-87659d2a5a70 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] HTTP exception thrown: Volume 642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 could not be found. Apr 13 17:45:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-a712d646-b036-4013-a798-87659d2a5a70 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Request method failure captured: Apr 13 17:45:37 user devstack@n-api.service[61678]: request: GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 HTTP/1.1 Apr 13 17:45:37 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:45:37 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:45:37 user devstack@n-api.service[61678]: Connection: close Apr 13 17:45:37 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:45:37 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:45:37 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:45:37 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:45:37 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD-5U5wOb6VL513cPayPjgGeh6RtQvOLM0mH4NG8toeiBYP8uqnPAk9hn56E0RuWqB1IJDzChfAxzNLB2V9fe2tTuNfKvYxunr-vi21SPYIDWg69Z_dK8at39C8yrs5r01Z0mY7xWRGRlnmT8h4dtiokYTkRwSdhts2FY5ajAK9Wpjc Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Project-Id: ca63819f62634963b979335807ae60f8 Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Project-Name: tempest-VolumesGetTestJSON-1882415161 Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ca63819f62634963b979335807ae60f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ca63819f62634963b979335807ae60f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ca63819f62634963b979335807ae60f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Tenant: tempest-VolumesGetTestJSON-1882415161 Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Tenant-Id: ca63819f62634963b979335807ae60f8 Apr 13 17:45:37 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-VolumesGetTestJSON-1882415161 Apr 13 17:45:37 user devstack@n-api.service[61678]: X-User: tempest-VolumesGetTestJSON-1882415161-project-member Apr 13 17:45:37 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:45:37 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:45:37 user devstack@n-api.service[61678]: X-User-Id: 2271c2c0a5de464a8b992c7306fa8995 Apr 13 17:45:37 user devstack@n-api.service[61678]: X-User-Name: tempest-VolumesGetTestJSON-1882415161-project-member Apr 13 17:45:37 user devstack@n-api.service[61678]: method: Apr 13 17:45:37 user devstack@n-api.service[61678]: exception: Volume 642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 could not be found. Apr 13 17:45:37 user devstack@n-api.service[61678]: action_args: {'id': '642a28ea-b9e4-42d2-a4f1-27dc9c595cf6'} Apr 13 17:45:37 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 could not be found. (HTTP 404) (Request-ID: req-97c34b7c-22df-4448-9152-4514561b9831) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 could not be found. Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 could not be found. Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 could not be found. Apr 13 17:45:37 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:45:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-a712d646-b036-4013-a798-87659d2a5a70 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] Returning 404 to user: Volume 642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:45:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-a712d646-b036-4013-a798-87659d2a5a70 tempest-VolumesGetTestJSON-1882415161 tempest-VolumesGetTestJSON-1882415161-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6" status: 404 len: 109 microversion: 2.1 time: 0.044590 Apr 13 17:45:37 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 21/64] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:45:37 2023] GET /compute/v2.1/os-volumes/642a28ea-b9e4-42d2-a4f1-27dc9c595cf6 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:45:47 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-b4c111eb-9f3f-4303-845f-317bb17a483b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'create', calling method: .version_select at 0x7f82e334b130>, body: {"keypair": {"name": "tempest-keypair-1272899020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:45:47 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-b4c111eb-9f3f-4303-845f-317bb17a483b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:45:47 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-b4c111eb-9f3f-4303-845f-317bb17a483b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for user 8f796555c0e242d091502725ec595c0f and project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:45:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-b4c111eb-9f3f-4303-845f-317bb17a483b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338688 Apr 13 17:45:47 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 22/65] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:45:47 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:45:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-448804682", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "387b7133-8551-4ab1-845e-7497a2abd8b3"}]}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:45:48 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] validate_networks() for [('387b7133-8551-4ab1-845e-7497a2abd8b3', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Getting quotas for project 3f4d4b5316fa45838c82ce0a0cfbc3dc. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Getting quotas for user 772b5f3399f247d191e0f32d386ecea6 and project 3f4d4b5316fa45838c82ce0a0cfbc3dc. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:45:50 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:45:50 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.717788 Apr 13 17:45:50 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 23/66] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:45:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:45:50 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9cf9a125-409b-467f-8641-05b97f6b9261 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:50 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9cf9a125-409b-467f-8641-05b97f6b9261 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:45:50 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-9cf9a125-409b-467f-8641-05b97f6b9261 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772b5f3399f247d191e0f32d386ecea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d4b5316fa45838c82ce0a0cfbc3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:45:50 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9cf9a125-409b-467f-8641-05b97f6b9261 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c" status: 200 len: 1208 microversion: 2.1 time: 0.216994 Apr 13 17:45:50 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 22/67] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:45:50 2023] GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c => generated 1208 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:45:54 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-743764397", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8"}]}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:45:54 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] validate_networks() for [('74134ba8-d8bf-4dbd-853e-3b5e62fad8e8', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Getting quotas for project b4fbca3daa10432c8abf5e8cc0dff050. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Getting quotas for user b33d4309055340a4b42df540ca62d59f and project b4fbca3daa10432c8abf5e8cc0dff050. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:45:55 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:45:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.729831 Apr 13 17:45:55 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:45:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:45:55 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-11cb0168-5c2c-4a3c-b195-91beb50553f0 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:45:55 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-11cb0168-5c2c-4a3c-b195-91beb50553f0 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:45:56 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-11cb0168-5c2c-4a3c-b195-91beb50553f0 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:45:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-11cb0168-5c2c-4a3c-b195-91beb50553f0 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b" status: 200 len: 1210 microversion: 2.1 time: 0.220956 Apr 13 17:45:56 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 24/69] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:45:55 2023] GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b => generated 1210 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:45:58 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1510345798", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:45:58 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] validate_networks() for [('9ff6a864-745a-48cf-b5d3-2ea27e2b03fa', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:45:58 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1478412498", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "10638cc2-22a6-4aac-b79a-2baa9327e1bc"}], "security_groups": [{"name": "tempest-securitygroup--2068620042"}], "key_name": "tempest-keypair-1272899020", "user_data": "}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:45:58 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] validate_networks() for [('10638cc2-22a6-4aac-b79a-2baa9327e1bc', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:45:59 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:45:59 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:45:59 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:45:59 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:45:59 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for user 8f796555c0e242d091502725ec595c0f and project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:46:00 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.409285 Apr 13 17:46:00 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 24/70] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:45:58 2023] POST /compute/v2.1/servers => generated 407 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:46:00 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2166625c-c4ab-4abd-97f8-351ba51ea424 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:00 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-2166625c-c4ab-4abd-97f8-351ba51ea424 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:00 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:00 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:00 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-2166625c-c4ab-4abd-97f8-351ba51ea424 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:00 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2166625c-c4ab-4abd-97f8-351ba51ea424 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1233 microversion: 2.1 time: 0.355892 Apr 13 17:46:00 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 25/71] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:00 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1233 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Getting quotas for project 8a40fa0611d54d5b8a35fcc469fc5361. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Getting quotas for user 75c1cf6ba73c4adb9124f14d78f4ac16 and project 8a40fa0611d54d5b8a35fcc469fc5361. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:46:00 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:46:00 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.879215 Apr 13 17:46:00 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 23/72] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:45:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 2885 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1afdd7d9-7bdb-4c7b-ae75-b4560056181d tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:00 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1afdd7d9-7bdb-4c7b-ae75-b4560056181d tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:01 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-1afdd7d9-7bdb-4c7b-ae75-b4560056181d tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c1cf6ba73c4adb9124f14d78f4ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a40fa0611d54d5b8a35fcc469fc5361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1afdd7d9-7bdb-4c7b-ae75-b4560056181d tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5" status: 200 len: 1208 microversion: 2.1 time: 0.422033 Apr 13 17:46:01 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 25/73] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:00 2023] GET /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5 => generated 1208 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:01 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-514875ab-a7b5-4239-ad9b-b4a0fb63d411 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Action: 'create', calling method: .version_select at 0x7f82e32ed870>, body: {"keypair": {"name": "tempest-keypair-1772761791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr+Qp1DpGYd28SffPEL0KXHEyGVeNEzd/4SaNj92SqYaC3oPsix558denqtUGb8CVqhKclqMvdjbWzCvn1ComQgDM/fgeBZ91Z9GAUCB0F7d60nu+OvCRg4Monp5Wob+A=="}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:01 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-514875ab-a7b5-4239-ad9b-b4a0fb63d411 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Getting quotas for project 984a0fd6f48449a7ba8f9944243580b9. Resources: {'key_pairs'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:01 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-514875ab-a7b5-4239-ad9b-b4a0fb63d411 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Getting quotas for user cbea54954e534fdc933b94936a47a0b3 and project 984a0fd6f48449a7ba8f9944243580b9. Resources: {'key_pairs'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:02 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-514875ab-a7b5-4239-ad9b-b4a0fb63d411 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.265797 Apr 13 17:46:02 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 26/74] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:46:01 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcf221f-b53a-4e85-9743-ee10ab3c387c", "tag": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Creating event network-changed:cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance bfcf221f-b53a-4e85-9743-ee10ab3c387c on user Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61678) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Acquired lock "compute-rpcapi-router" {{(pid=61678) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9639f623-2654-4541-b2b5-cfbd3d2f5ab9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9639f623-2654-4541-b2b5-cfbd3d2f5ab9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9639f623-2654-4541-b2b5-cfbd3d2f5ab9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9639f623-2654-4541-b2b5-cfbd3d2f5ab9 None None] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9639f623-2654-4541-b2b5-cfbd3d2f5ab9 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9639f623-2654-4541-b2b5-cfbd3d2f5ab9 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:02 user devstack@n-api.service[61678]: INFO nova.compute.rpcapi [None req-9639f623-2654-4541-b2b5-cfbd3d2f5ab9 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 17:46:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9639f623-2654-4541-b2b5-cfbd3d2f5ab9 None None] Releasing lock "compute-rpcapi-router" {{(pid=61678) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 17:46:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9639f623-2654-4541-b2b5-cfbd3d2f5ab9 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230113 Apr 13 17:46:02 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 24/75] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:04 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc89ac54-6844-45b9-8dac-c10d893b699b", "tag": "6431e14a-e7e3-4cb5-9fe6-015c1debef03"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Creating event network-changed:6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance bc89ac54-6844-45b9-8dac-c10d893b699b on user Apr 13 17:46:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61677) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 17:46:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61677) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 17:46:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f4643f23-6767-42e6-96a3-d282a3f32fa5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f4643f23-6767-42e6-96a3-d282a3f32fa5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f4643f23-6767-42e6-96a3-d282a3f32fa5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f4643f23-6767-42e6-96a3-d282a3f32fa5 None None] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f4643f23-6767-42e6-96a3-d282a3f32fa5 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f4643f23-6767-42e6-96a3-d282a3f32fa5 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:05 user devstack@n-api.service[61677]: INFO nova.compute.rpcapi [None req-f4643f23-6767-42e6-96a3-d282a3f32fa5 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 17:46:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f4643f23-6767-42e6-96a3-d282a3f32fa5 None None] Releasing lock "compute-rpcapi-router" {{(pid=61677) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 17:46:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f4643f23-6767-42e6-96a3-d282a3f32fa5 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131523 Apr 13 17:46:05 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 26/76] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:07 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Creating event network-changed:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61676) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61676) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7c51857b-aae4-4235-96d3-64ef8daccf72 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7c51857b-aae4-4235-96d3-64ef8daccf72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7c51857b-aae4-4235-96d3-64ef8daccf72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7c51857b-aae4-4235-96d3-64ef8daccf72 None None] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7c51857b-aae4-4235-96d3-64ef8daccf72 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7c51857b-aae4-4235-96d3-64ef8daccf72 None None] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:07 user devstack@n-api.service[61676]: INFO nova.compute.rpcapi [None req-7c51857b-aae4-4235-96d3-64ef8daccf72 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 17:46:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7c51857b-aae4-4235-96d3-64ef8daccf72 None None] Releasing lock "compute-rpcapi-router" {{(pid=61676) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 17:46:07 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-7c51857b-aae4-4235-96d3-64ef8daccf72 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216385 Apr 13 17:46:07 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:10 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc89ac54-6844-45b9-8dac-c10d893b699b", "name": "network-vif-plugged", "status": "completed", "tag": "6431e14a-e7e3-4cb5-9fe6-015c1debef03"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:10 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] Creating event network-vif-plugged:6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance bc89ac54-6844-45b9-8dac-c10d893b699b on user Apr 13 17:46:10 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038105 Apr 13 17:46:10 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 25/78] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:10 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcf221f-b53a-4e85-9743-ee10ab3c387c", "name": "network-vif-plugged", "status": "completed", "tag": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:10 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:10 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:10 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:10 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] Creating event network-vif-plugged:cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance bfcf221f-b53a-4e85-9743-ee10ab3c387c on user Apr 13 17:46:10 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162114 Apr 13 17:46:10 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:11 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:46:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047684 Apr 13 17:46:11 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 28/80] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:11 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:11 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-547648089", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "27d613f4-b813-4f4f-90a9-924fab95dfda"}], "security_groups": [{"name": "tempest-securitygroup--1273211565"}], "key_name": "tempest-keypair-1772761791", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:12 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=18 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc89ac54-6844-45b9-8dac-c10d893b699b", "name": "network-vif-plugged", "status": "completed", "tag": "6431e14a-e7e3-4cb5-9fe6-015c1debef03"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:12 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] Creating event network-vif-plugged:6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance bc89ac54-6844-45b9-8dac-c10d893b699b on user Apr 13 17:46:12 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073015 Apr 13 17:46:12 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:12 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] validate_networks() for [('27d613f4-b813-4f4f-90a9-924fab95dfda', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:46:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:12 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=14 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcf221f-b53a-4e85-9743-ee10ab3c387c", "name": "network-vif-plugged", "status": "completed", "tag": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e"}, {"name": "network-changed", "server_uuid": "fd435a8f-372c-4aab-81b0-a1f76658b5b5", "tag": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Creating event network-vif-plugged:cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance bfcf221f-b53a-4e85-9743-ee10ab3c387c on user Apr 13 17:46:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Creating event network-changed:9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 on user Apr 13 17:46:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.073617 Apr 13 17:46:12 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 29/82] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:12 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:13 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:46:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054303 Apr 13 17:46:13 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 29/83] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Getting quotas for project 984a0fd6f48449a7ba8f9944243580b9. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Getting quotas for user cbea54954e534fdc933b94936a47a0b3 and project 984a0fd6f48449a7ba8f9944243580b9. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:46:14 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:46:14 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.161138 Apr 13 17:46:14 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 26/84] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:46:11 2023] POST /compute/v2.1/servers => generated 404 bytes in 3163 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:46:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-541f0854-6c94-40b9-8d8e-14158d8ca522 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:14 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-541f0854-6c94-40b9-8d8e-14158d8ca522 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:15 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-541f0854-6c94-40b9-8d8e-14158d8ca522 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbea54954e534fdc933b94936a47a0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a0fd6f48449a7ba8f9944243580b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-541f0854-6c94-40b9-8d8e-14158d8ca522 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef" status: 200 len: 1239 microversion: 2.1 time: 0.276844 Apr 13 17:46:15 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 30/85] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:14 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef => generated 1239 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:16 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd435a8f-372c-4aab-81b0-a1f76658b5b5", "name": "network-vif-plugged", "status": "completed", "tag": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] Creating event network-vif-plugged:9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 on user Apr 13 17:46:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066447 Apr 13 17:46:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:17 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-46a48559-56a6-4c40-8cff-b567326446ab tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Action: 'create', calling method: .version_select at 0x7f82e32cd3f0>, body: {"keypair": {"name": "tempest-keypair-1911294089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNL/l3knLiGldwyflv/CZJe/UzD7tOPLEZPBkP18IAdcrOMkyDnl46cyo3jZSIFKOsS8+fVwmaiY3fk0liB5b07xzaHFCyr8+LNzfg1+EXTpq2CFfBk1qtKS/qY8fmuYw=="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:18 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-46a48559-56a6-4c40-8cff-b567326446ab tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Getting quotas for project 2d6ea575d2574fcc99712adece6db415. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:18 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-46a48559-56a6-4c40-8cff-b567326446ab tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Getting quotas for user 5d77fa5340ce44099224f2f161af5ecc and project 2d6ea575d2574fcc99712adece6db415. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-46a48559-56a6-4c40-8cff-b567326446ab tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.585889 Apr 13 17:46:18 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 27/87] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:46:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:46:18 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd435a8f-372c-4aab-81b0-a1f76658b5b5", "name": "network-vif-plugged", "status": "completed", "tag": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:18 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] Creating event network-vif-plugged:9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 on user Apr 13 17:46:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135194 Apr 13 17:46:18 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 31/88] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:19 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8287c861-c28e-4b5e-8221-8cf320d10992 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Action: 'create', calling method: .version_select at 0x7f82e3349ea0>, body: {"keypair": {"name": "tempest-keypair-1143642649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU+SDMniOXw84ibDM7Gr2Fasc8Cy3YObgo+qLbZd0zzuH5EuEl03YcmcoTwxkNgNPk/4Qn+WhACjat3sYKtHXLyw6ONjwOG/Fi6pR193B3tO1ZEkqk3Wu2MsP2bSP51Bg=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:19 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=7 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:19 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-8287c861-c28e-4b5e-8221-8cf320d10992 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Getting quotas for project 900c1c4928514f198a3b630de0216b60. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:19 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-8287c861-c28e-4b5e-8221-8cf320d10992 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Getting quotas for user 8f5fc6a5e3a54d619d57cb94bdb304c5 and project 900c1c4928514f198a3b630de0216b60. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:19 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8287c861-c28e-4b5e-8221-8cf320d10992 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.570585 Apr 13 17:46:19 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 31/89] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:46:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:46:20 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7519e758-1e33-4433-94f0-af9b22c65fde tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Action: 'create', calling method: .version_select at 0x7f82e32cc1f0>, body: {"keypair": {"name": "tempest-keypair-573436766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHliqmBvXni1z1lSQ9+BPDZpXY+5Ahm8yw2vvM1dM/dD3VVaH+n290mcGYbV0smQzfAewnTjJfL5irp7biydbsFyUv3y2r7mdKjKMJg2VeEnlJlYqpcHulTXS5EGf6D/w=="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:20 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=7 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:20 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-7519e758-1e33-4433-94f0-af9b22c65fde tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Getting quotas for project c2125d26c69b434380ee15d03c9a196b. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:20 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-7519e758-1e33-4433-94f0-af9b22c65fde tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Getting quotas for user 3023cacc072d43119d59765f0e0c5da7 and project c2125d26c69b434380ee15d03c9a196b. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7519e758-1e33-4433-94f0-af9b22c65fde tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118370 Apr 13 17:46:20 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 28/90] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:46:20 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:21 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-394613299", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "78f8d90f-b42e-43ff-8216-42798f0b8a43"}], "security_groups": [{"name": "tempest-securitygroup--395840702"}], "key_name": "tempest-keypair-1911294089", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:21 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:21 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] validate_networks() for [('78f8d90f-b42e-43ff-8216-42798f0b8a43', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:46:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69605608-790d-49be-ab18-277549242bef", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:22 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=17 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] Creating event network-changed:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:46:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042888 Apr 13 17:46:22 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 32/91] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Getting quotas for project 2d6ea575d2574fcc99712adece6db415. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Getting quotas for user 5d77fa5340ce44099224f2f161af5ecc and project 2d6ea575d2574fcc99712adece6db415. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:46:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:46:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.510215 Apr 13 17:46:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 32/92] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:46:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:46:22 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f2cabe78-7923-4c2f-a162-a084d0edda63 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:22 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f2cabe78-7923-4c2f-a162-a084d0edda63 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:22 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-f2cabe78-7923-4c2f-a162-a084d0edda63 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d77fa5340ce44099224f2f161af5ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ea575d2574fcc99712adece6db415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f2cabe78-7923-4c2f-a162-a084d0edda63 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0" status: 200 len: 1235 microversion: 2.1 time: 0.103611 Apr 13 17:46:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 29/93] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:22 2023] GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0 => generated 1235 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:23 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2041945976", "imageRef": "5f64c281-530b-48dc-b419-d28e323bbf14", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c"}], "security_groups": [{"name": "tempest-securitygroup--1350183929"}], "key_name": "tempest-keypair-1143642649", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:23 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] validate_networks() for [('a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:46:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1753786794", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "4ac3b800-54d0-436a-ac12-39bbfaee61e4"}], "security_groups": [{"name": "tempest-securitygroup--1896341827"}], "key_name": "tempest-keypair-573436766", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:46:24 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] validate_networks() for [('4ac3b800-54d0-436a-ac12-39bbfaee61e4', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Getting quotas for project 900c1c4928514f198a3b630de0216b60. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Getting quotas for user 8f5fc6a5e3a54d619d57cb94bdb304c5 and project 900c1c4928514f198a3b630de0216b60. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:46:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5f64c281-530b-48dc-b419-d28e323bbf14',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:46:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.966725 Apr 13 17:46:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 33/94] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:46:23 2023] POST /compute/v2.1/servers => generated 404 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 17:46:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-54c39b3d-ef24-4263-af3c-2a43d7a9884b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:25 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-54c39b3d-ef24-4263-af3c-2a43d7a9884b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:25 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:25 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=10 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:25 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-54c39b3d-ef24-4263-af3c-2a43d7a9884b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f5fc6a5e3a54d619d57cb94bdb304c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900c1c4928514f198a3b630de0216b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-54c39b3d-ef24-4263-af3c-2a43d7a9884b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df" status: 200 len: 1240 microversion: 2.1 time: 0.151791 Apr 13 17:46:25 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 30/95] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:25 2023] GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df => generated 1240 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-plugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] Creating event network-vif-plugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:46:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097374 Apr 13 17:46:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 34/96] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:25 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Getting quotas for project c2125d26c69b434380ee15d03c9a196b. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:26 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Getting quotas for user 3023cacc072d43119d59765f0e0c5da7 and project c2125d26c69b434380ee15d03c9a196b. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:26 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:46:26 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:46:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.743849 Apr 13 17:46:26 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 33/97] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:46:24 2023] POST /compute/v2.1/servers => generated 404 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:46:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-31a89522-5c6f-4fdb-a35f-9c7b688030ad tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:26 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-31a89522-5c6f-4fdb-a35f-9c7b688030ad tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:26 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-31a89522-5c6f-4fdb-a35f-9c7b688030ad tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023cacc072d43119d59765f0e0c5da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2125d26c69b434380ee15d03c9a196b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-31a89522-5c6f-4fdb-a35f-9c7b688030ad tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" status: 200 len: 1225 microversion: 2.1 time: 0.109956 Apr 13 17:46:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 31/98] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:26 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-plugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] Creating event network-vif-plugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:46:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100253 Apr 13 17:46:27 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 35/99] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f8857e-9e9b-4a5a-912a-4d79014417d0", "tag": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] Creating event network-changed:965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 on user Apr 13 17:46:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038367 Apr 13 17:46:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 34/100] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1b241a-4461-41d9-8890-012ddbda76df", "tag": "d6142a48-379f-470e-aaf0-a2dd0e626d72"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] Creating event network-changed:d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance 1a1b241a-4461-41d9-8890-012ddbda76df on user Apr 13 17:46:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078050 Apr 13 17:46:29 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 32/101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11", "tag": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] Creating event network-changed:0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 on user Apr 13 17:46:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098356 Apr 13 17:46:31 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 36/102] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1b241a-4461-41d9-8890-012ddbda76df", "name": "network-vif-plugged", "status": "completed", "tag": "d6142a48-379f-470e-aaf0-a2dd0e626d72"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:33 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=17 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] Creating event network-vif-plugged:d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance 1a1b241a-4461-41d9-8890-012ddbda76df on user Apr 13 17:46:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036793 Apr 13 17:46:33 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 35/103] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:35 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f8857e-9e9b-4a5a-912a-4d79014417d0", "name": "network-vif-plugged", "status": "completed", "tag": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] Creating event network-vif-plugged:965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 on user Apr 13 17:46:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037217 Apr 13 17:46:35 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 33/104] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:35 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:35 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:35 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11", "name": "network-vif-plugged", "status": "completed", "tag": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] Creating event network-vif-plugged:0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 on user Apr 13 17:46:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032002 Apr 13 17:46:35 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 37/105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1b241a-4461-41d9-8890-012ddbda76df", "name": "network-vif-plugged", "status": "completed", "tag": "d6142a48-379f-470e-aaf0-a2dd0e626d72"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] Creating event network-vif-plugged:d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance 1a1b241a-4461-41d9-8890-012ddbda76df on user Apr 13 17:46:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046125 Apr 13 17:46:35 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 36/106] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:37 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=20 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f8857e-9e9b-4a5a-912a-4d79014417d0", "name": "network-vif-plugged", "status": "completed", "tag": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] Creating event network-vif-plugged:965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 on user Apr 13 17:46:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036618 Apr 13 17:46:37 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 34/107] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11", "name": "network-vif-plugged", "status": "completed", "tag": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] Creating event network-vif-plugged:0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 on user Apr 13 17:46:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070864 Apr 13 17:46:37 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 38/108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=14 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:40 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772b5f3399f247d191e0f32d386ecea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d4b5316fa45838c82ce0a0cfbc3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-52e4aeb4-2514-4a36-a8b4-ac18056788c3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c" status: 200 len: 1489 microversion: 2.1 time: 0.358165 Apr 13 17:46:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 37/109] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:40 2023] GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c => generated 1489 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:46 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:46 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:46 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-80e16d78-49c9-46be-9f96-2d0e636ef370 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b" status: 200 len: 1494 microversion: 2.1 time: 0.398120 Apr 13 17:46:46 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 35/110] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:46 2023] GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b => generated 1494 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:47 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f5b69928-f2bb-42c4-ae5d-02374c0d8b9b tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Action: 'create', calling method: .version_select at 0x7f82e32b35b0>, body: {"keypair": {"name": "tempest-keypair-1843115864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:47 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-f5b69928-f2bb-42c4-ae5d-02374c0d8b9b tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Getting quotas for project b192b3270576450b8c39368f07d1fae2. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:47 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-f5b69928-f2bb-42c4-ae5d-02374c0d8b9b tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Getting quotas for user 4b46c336863a41f8a8429fdad30297a0 and project b192b3270576450b8c39368f07d1fae2. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f5b69928-f2bb-42c4-ae5d-02374c0d8b9b tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.117879 Apr 13 17:46:47 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 39/111] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 17:46:47 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 17:46:49 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-326203077", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "1db53756-cfdb-4e80-a667-e8c0d854e760"}, {"port": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "tag": "port-1"}, {"port": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "tag": "port-2"}, {"uuid": "644e4ae4-6cea-480d-8625-7375da83264e", "tag": "net-1"}, {"uuid": "644e4ae4-6cea-480d-8625-7375da83264e"}, {"uuid": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "267ae4b0-e7ad-4ed8-abec-00760971ce21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "76bf1eb0-235d-4aec-8895-594830d9b8ce", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "eb71648a-a496-4b94-a14e-061f9eb3b3db", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--204835764"}], "key_name": "tempest-keypair-1843115864", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:49 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] validate_networks() for [('1db53756-cfdb-4e80-a667-e8c0d854e760', None, None, None, None, None), (None, None, '9dd21baf-0c87-4035-817b-3ecf6dad3ec1', None, None, None), (None, None, 'f454a828-50c6-43ba-ae8b-f2b86adbde6d', None, None, None), ('644e4ae4-6cea-480d-8625-7375da83264e', None, None, None, None, None), ('644e4ae4-6cea-480d-8625-7375da83264e', None, None, None, None, None), ('d6076dd0-0264-48f6-aa40-b5f348cb1d21', '10.2.2.100', None, None, None, None), ('d6076dd0-0264-48f6-aa40-b5f348cb1d21', '10.2.2.200', None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:46:50 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:50 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:50 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:50 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5e2d4747-2333-474a-b047-78947fc05589 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1540 microversion: 2.1 time: 0.259131 Apr 13 17:46:50 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 36/112] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:50 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1540 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:50 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=9 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:51 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=13 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:51 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1e6922ff-376f-42b9-823b-6567c866e460 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Action: 'create', calling method: .version_select at 0x7f82e2922320>, body: {"keypair": {"name": "tempest-keypair-1897677956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:51 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=5 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:51 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-1e6922ff-376f-42b9-823b-6567c866e460 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Getting quotas for project fff9543b4dea4fe094f886408bfa5865. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:51 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-1e6922ff-376f-42b9-823b-6567c866e460 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Getting quotas for user c62d905cbf3043c28a2a0ad2cab40197 and project fff9543b4dea4fe094f886408bfa5865. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:51 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1e6922ff-376f-42b9-823b-6567c866e460 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.064307 Apr 13 17:46:51 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 40/113] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 17:46:51 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:51 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c1cf6ba73c4adb9124f14d78f4ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a40fa0611d54d5b8a35fcc469fc5361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-b738e827-1285-4ec4-b614-2a3a8bcfa77b tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5" status: 200 len: 1486 microversion: 2.1 time: 0.358848 Apr 13 17:46:51 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 37/114] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:46:51 2023] GET /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5 => generated 1486 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Getting quotas for project b192b3270576450b8c39368f07d1fae2. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Getting quotas for user 4b46c336863a41f8a8429fdad30297a0 and project b192b3270576450b8c39368f07d1fae2. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:46:52 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='267ae4b0-e7ad-4ed8-abec-00760971ce21',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='76bf1eb0-235d-4aec-8895-594830d9b8ce',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb71648a-a496-4b94-a14e-061f9eb3b3db',volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:46:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 3.260555 Apr 13 17:46:52 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 38/115] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 17:46:49 2023] POST /compute/v2.1/servers => generated 403 bytes in 3262 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 17:46:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3b051176-9b43-4d7a-841c-f93a75fb98a0 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:52 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3b051176-9b43-4d7a-841c-f93a75fb98a0 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:53 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-3b051176-9b43-4d7a-841c-f93a75fb98a0 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:53 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-3b051176-9b43-4d7a-841c-f93a75fb98a0 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:53 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-3b051176-9b43-4d7a-841c-f93a75fb98a0 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3b051176-9b43-4d7a-841c-f93a75fb98a0 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170" status: 200 len: 1279 microversion: 2.42 time: 0.087165 Apr 13 17:46:53 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 41/116] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:46:52 2023] GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:46:53 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-612269099", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "61e4464a-644e-4c8f-b177-341dae607f50"}, {"port": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "tag": "port-1"}, {"port": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "tag": "port-2"}, {"uuid": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "tag": "net-1"}, {"uuid": "2871b866-1912-4fea-a7f2-c68b85ddfc2d"}, {"uuid": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "193d8f02-ca54-46d6-896c-694afc0eef51", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d8bbde54-82c8-4365-80db-fc400c9cf78e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "13ffd808-19cd-4644-b2e5-3a85520a4d43", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--978129054"}], "key_name": "tempest-keypair-1897677956", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:46:53 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] validate_networks() for [('61e4464a-644e-4c8f-b177-341dae607f50', None, None, None, None, None), (None, None, '7c1cce3f-97ef-437a-8d7a-728cdf0a0b11', None, None, None), (None, None, '8a952bca-a9c0-4f7b-a8d5-8639983809cf', None, None, None), ('2871b866-1912-4fea-a7f2-c68b85ddfc2d', None, None, None, None, None), ('2871b866-1912-4fea-a7f2-c68b85ddfc2d', None, None, None, None, None), ('47107af9-74a2-4df2-bcec-08f68c7d62ae', '10.2.2.100', None, None, None, None), ('47107af9-74a2-4df2-bcec-08f68c7d62ae', '10.2.2.200', None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=25 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Getting quotas for project fff9543b4dea4fe094f886408bfa5865. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:46:55 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Getting quotas for user c62d905cbf3043c28a2a0ad2cab40197 and project fff9543b4dea4fe094f886408bfa5865. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:46:56 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:46:56 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='193d8f02-ca54-46d6-896c-694afc0eef51',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d8bbde54-82c8-4365-80db-fc400c9cf78e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13ffd808-19cd-4644-b2e5-3a85520a4d43',volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:46:56 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 2.890991 Apr 13 17:46:56 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 38/117] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 17:46:53 2023] POST /compute/v2.1/servers => generated 403 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 17:46:56 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-d3f2b028-2db6-4191-8bcc-84bec8089ec0 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:46:56 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-d3f2b028-2db6-4191-8bcc-84bec8089ec0 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:46:56 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-d3f2b028-2db6-4191-8bcc-84bec8089ec0 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:56 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-d3f2b028-2db6-4191-8bcc-84bec8089ec0 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:56 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-d3f2b028-2db6-4191-8bcc-84bec8089ec0 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:46:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-d3f2b028-2db6-4191-8bcc-84bec8089ec0 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" status: 200 len: 1279 microversion: 2.32 time: 0.076102 Apr 13 17:46:56 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 39/118] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:46:56 2023] GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => generated 1279 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:47:00 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "tag": "054f8815-c1d1-4b57-9018-a34c8e785b80"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:00 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] Creating event network-changed:054f8815-c1d1-4b57-9018-a34c8e785b80 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:00 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048998 Apr 13 17:47:00 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 42/119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:02 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "tag": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1"}, {"name": "network-changed", "server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "tag": "f454a828-50c6-43ba-ae8b-f2b86adbde6d"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Creating event network-changed:9dd21baf-0c87-4035-817b-3ecf6dad3ec1 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Creating event network-changed:f454a828-50c6-43ba-ae8b-f2b86adbde6d for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053970 Apr 13 17:47:02 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 39/120] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:02 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:02 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "tag": "07509622-d164-4038-ba75-5bf6cd52d615"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:02 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:02 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:02 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] Creating event network-changed:07509622-d164-4038-ba75-5bf6cd52d615 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:02 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043787 Apr 13 17:47:02 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:04 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:04 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "tag": "2968f077-89fd-47b8-b2d8-2be699130a08"}, {"name": "network-changed", "server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "tag": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Creating event network-changed:2968f077-89fd-47b8-b2d8-2be699130a08 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Creating event network-changed:90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050601 Apr 13 17:47:04 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 43/122] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:04 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "tag": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11"}, {"name": "network-changed", "server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "tag": "8a952bca-a9c0-4f7b-a8d5-8639983809cf"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Creating event network-changed:7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Creating event network-changed:8a952bca-a9c0-4f7b-a8d5-8639983809cf for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049958 Apr 13 17:47:04 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 40/123] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:05 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:05 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:05 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbea54954e534fdc933b94936a47a0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a0fd6f48449a7ba8f9944243580b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0c5f730e-2648-4f2f-8748-3eab5cff2bb6 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef" status: 200 len: 1553 microversion: 2.1 time: 0.252096 Apr 13 17:47:05 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 41/124] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:05 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef => generated 1553 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:06 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "tag": "7794066e-1eb8-4f57-b683-af981db15421"}, {"name": "network-changed", "server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "tag": "365ecb91-8df1-419a-b559-ab5f41e6e38f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Creating event network-changed:7794066e-1eb8-4f57-b683-af981db15421 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Creating event network-changed:365ecb91-8df1-419a-b559-ab5f41e6e38f for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035158 Apr 13 17:47:06 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 44/125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:06 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:06 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:06 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "tag": "c69b7013-5290-4bec-91d4-d1c86c94e982"}, {"name": "network-changed", "server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "tag": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63"}, {"name": "network-changed", "server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "tag": "09e76676-6015-4205-bd23-b86f896fb6d1"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:06 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Creating event network-changed:c69b7013-5290-4bec-91d4-d1c86c94e982 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:06 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Creating event network-changed:fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:06 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Creating event network-changed:09e76676-6015-4205-bd23-b86f896fb6d1 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:06 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.038375 Apr 13 17:47:06 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 41/126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:08 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "tag": "4f9e9206-943a-43f9-a511-18ed9e8b8c40"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:08 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:08 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] Creating event network-changed:4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:08 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032264 Apr 13 17:47:08 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 42/127] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:12 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:13 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d77fa5340ce44099224f2f161af5ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ea575d2574fcc99712adece6db415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-c74e482a-0e4b-486d-a06e-7e3d8ebbbd20 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0" status: 200 len: 1543 microversion: 2.1 time: 0.258814 Apr 13 17:47:13 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 45/128] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:12 2023] GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0 => generated 1543 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:15 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:15 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f5fc6a5e3a54d619d57cb94bdb304c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900c1c4928514f198a3b630de0216b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-70c7af50-5476-4612-9992-d1c125158318 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df" status: 200 len: 1548 microversion: 2.1 time: 0.198605 Apr 13 17:47:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 42/129] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:15 2023] GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df => generated 1548 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:16 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:16 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:16 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023cacc072d43119d59765f0e0c5da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2125d26c69b434380ee15d03c9a196b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:16 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-759f8979-f3b7-4360-8a77-8ab3c1f66f9d tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" status: 200 len: 1525 microversion: 2.1 time: 0.248365 Apr 13 17:47:16 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 43/130] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:16 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 => generated 1525 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "07509622-d164-4038-ba75-5bf6cd52d615"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:22 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:22 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=13 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] Creating event network-vif-plugged:07509622-d164-4038-ba75-5bf6cd52d615 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051104 Apr 13 17:47:22 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 46/131] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:23 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:23 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:23 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:23 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:23 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:23 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] Creating event network-vif-plugged:7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:23 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065989 Apr 13 17:47:23 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 43/132] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "07509622-d164-4038-ba75-5bf6cd52d615"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:24 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Creating event network-vif-plugged:07509622-d164-4038-ba75-5bf6cd52d615 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Creating event network-vif-plugged:fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069000 Apr 13 17:47:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 44/133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "8a952bca-a9c0-4f7b-a8d5-8639983809cf"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "8a952bca-a9c0-4f7b-a8d5-8639983809cf"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "c69b7013-5290-4bec-91d4-d1c86c94e982"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "c69b7013-5290-4bec-91d4-d1c86c94e982"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Creating event network-vif-plugged:7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Creating event network-vif-plugged:8a952bca-a9c0-4f7b-a8d5-8639983809cf for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Creating event network-vif-plugged:8a952bca-a9c0-4f7b-a8d5-8639983809cf for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Creating event network-vif-plugged:c69b7013-5290-4bec-91d4-d1c86c94e982 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Creating event network-vif-plugged:c69b7013-5290-4bec-91d4-d1c86c94e982 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.071695 Apr 13 17:47:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 47/134] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:25 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "09e76676-6015-4205-bd23-b86f896fb6d1"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "09e76676-6015-4205-bd23-b86f896fb6d1"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "054f8815-c1d1-4b57-9018-a34c8e785b80"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:26 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=16 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Creating event network-vif-plugged:fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Creating event network-vif-plugged:09e76676-6015-4205-bd23-b86f896fb6d1 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Creating event network-vif-plugged:09e76676-6015-4205-bd23-b86f896fb6d1 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Creating event network-vif-plugged:054f8815-c1d1-4b57-9018-a34c8e785b80 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.054803 Apr 13 17:47:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 44/135] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:26 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:47:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "4f9e9206-943a-43f9-a511-18ed9e8b8c40"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "4f9e9206-943a-43f9-a511-18ed9e8b8c40"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Creating event network-vif-plugged:4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Creating event network-vif-plugged:4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:47:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046926 Apr 13 17:47:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 45/136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:28 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "7794066e-1eb8-4f57-b683-af981db15421"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:28 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] Creating event network-vif-plugged:7794066e-1eb8-4f57-b683-af981db15421 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:28 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076280 Apr 13 17:47:28 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 48/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "054f8815-c1d1-4b57-9018-a34c8e785b80"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "f454a828-50c6-43ba-ae8b-f2b86adbde6d"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "f454a828-50c6-43ba-ae8b-f2b86adbde6d"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "2968f077-89fd-47b8-b2d8-2be699130a08"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "2968f077-89fd-47b8-b2d8-2be699130a08"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Creating event network-vif-plugged:054f8815-c1d1-4b57-9018-a34c8e785b80 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Creating event network-vif-plugged:9dd21baf-0c87-4035-817b-3ecf6dad3ec1 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Creating event network-vif-plugged:9dd21baf-0c87-4035-817b-3ecf6dad3ec1 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Creating event network-vif-plugged:f454a828-50c6-43ba-ae8b-f2b86adbde6d for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Creating event network-vif-plugged:f454a828-50c6-43ba-ae8b-f2b86adbde6d for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Creating event network-vif-plugged:2968f077-89fd-47b8-b2d8-2be699130a08 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Creating event network-vif-plugged:2968f077-89fd-47b8-b2d8-2be699130a08 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Creating event network-vif-plugged:90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1380 microversion: 2.1 time: 0.043566 Apr 13 17:47:29 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 45/138] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 17:47:29 2023] POST /compute/v2.1/os-server-external-events => generated 1380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "7794066e-1eb8-4f57-b683-af981db15421"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] Creating event network-vif-plugged:7794066e-1eb8-4f57-b683-af981db15421 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039764 Apr 13 17:47:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-4e3c38c8-24cd-4ed7-8926-13ff960dc730 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'create', calling method: .version_select at 0x7f82e2922d40>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1346102396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/2PIs0BfFialBDNocPazDA/7rcCSlekPCMClQWyTEMb6n1ciIKA+7x1YWnMu59VjBTN1RxVDL9czLGIimP/yS7uC1ovBjrwoBUhVDzxZnPetW7Zt6HOn50CCv1S+GDTg=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:31 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-4e3c38c8-24cd-4ed7-8926-13ff960dc730 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting quotas for project 88bc3754064947c89397db4a80161b3a. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:47:31 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "365ecb91-8df1-419a-b559-ab5f41e6e38f"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "365ecb91-8df1-419a-b559-ab5f41e6e38f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:31 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-4e3c38c8-24cd-4ed7-8926-13ff960dc730 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting quotas for user 8bdac67b9cc149b4b802c96fc87fc801 and project 88bc3754064947c89397db4a80161b3a. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:47:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-4e3c38c8-24cd-4ed7-8926-13ff960dc730 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.089233 Apr 13 17:47:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Creating event network-vif-plugged:90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:31 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 49/140] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:47:31 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Creating event network-vif-plugged:365ecb91-8df1-419a-b559-ab5f41e6e38f for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Creating event network-vif-plugged:365ecb91-8df1-419a-b559-ab5f41e6e38f for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:47:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.060733 Apr 13 17:47:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 46/141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:47:31 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-652760998", "imageRef": "f74a8be6-03b3-48d9-81ef-7d62c11ef0e3", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1346102396", "networks": [{"uuid": "53908975-b8a1-42b2-a261-83a8ab29f858"}]}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:31 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] validate_networks() for [('53908975-b8a1-42b2-a261-83a8ab29f858', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting quotas for project 88bc3754064947c89397db4a80161b3a. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting quotas for user 8bdac67b9cc149b4b802c96fc87fc801 and project 88bc3754064947c89397db4a80161b3a. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:47:32 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:47:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.860119 Apr 13 17:47:32 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 47/142] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:47:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:47:32 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-b85bea79-5179-4fe6-baf5-0f55fd8fa297 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:32 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-b85bea79-5179-4fe6-baf5-0f55fd8fa297 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:32 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-b85bea79-5179-4fe6-baf5-0f55fd8fa297 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-b85bea79-5179-4fe6-baf5-0f55fd8fa297 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 200 len: 1252 microversion: 2.1 time: 0.125790 Apr 13 17:47:32 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 50/143] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:32 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 1252 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:35 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] Creating event network-changed:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:47:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042380 Apr 13 17:47:35 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 47/144] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "name": "network-vif-plugged", "status": "completed", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:38 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=25 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] Creating event network-vif-plugged:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:47:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072123 Apr 13 17:47:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "name": "network-vif-plugged", "status": "completed", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:40 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=5 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] Creating event network-vif-plugged:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:47:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045049 Apr 13 17:47:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 51/146] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "916775cf-a7af-491f-b7ea-3c1b57369f17"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:42 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493614 Apr 13 17:47:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 48/147] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:47:42 2023] POST /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:43 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:43 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c3f21447-7b63-4866-9c1b-395bed7cf738 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170" status: 200 len: 2823 microversion: 2.42 time: 0.355237 Apr 13 17:47:43 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 49/148] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:47:43 2023] GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 => generated 2823 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:46 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-199077965", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:46 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] validate_networks() for [('74134ba8-d8bf-4dbd-853e-3b5e62fad8e8', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:46 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:46 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-5ef4d4be-bc90-4c8e-b2bb-323149e464b3 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" status: 200 len: 2814 microversion: 2.32 time: 0.457657 Apr 13 17:47:46 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 52/149] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:47:46 2023] GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => generated 2814 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Getting quotas for project b4fbca3daa10432c8abf5e8cc0dff050. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Getting quotas for user b33d4309055340a4b42df540ca62d59f and project b4fbca3daa10432c8abf5e8cc0dff050. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:47:47 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:47:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.589021 Apr 13 17:47:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 49/150] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:47:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:47:47 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f515c4a0-de15-4614-b7a9-0de2a08047b4 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:47 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f515c4a0-de15-4614-b7a9-0de2a08047b4 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:47 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-f515c4a0-de15-4614-b7a9-0de2a08047b4 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:47 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f515c4a0-de15-4614-b7a9-0de2a08047b4 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5" status: 200 len: 1210 microversion: 2.1 time: 0.087203 Apr 13 17:47:47 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 50/151] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:47 2023] GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:50 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0243764f-846b-4675-9ea1-49d07b05cdb5", "tag": "cb49c554-4ee4-463a-9556-318e3aae8a0f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] Creating event network-changed:cb49c554-4ee4-463a-9556-318e3aae8a0f for instance 0243764f-846b-4675-9ea1-49d07b05cdb5 on user Apr 13 17:47:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040798 Apr 13 17:47:50 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 53/152] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:50 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ac8051fa-d133-4013-a532-05a4c2daae37 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:50 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ac8051fa-d133-4013-a532-05a4c2daae37 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ac8051fa-d133-4013-a532-05a4c2daae37 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ac8051fa-d133-4013-a532-05a4c2daae37 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ac8051fa-d133-4013-a532-05a4c2daae37 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ac8051fa-d133-4013-a532-05a4c2daae37 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ac8051fa-d133-4013-a532-05a4c2daae37 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ac8051fa-d133-4013-a532-05a4c2daae37 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ac8051fa-d133-4013-a532-05a4c2daae37 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101732 Apr 13 17:47:51 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 50/153] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:47:50 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-interface => generated 282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:51 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:51 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:51 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:47:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c" status: 204 len: 0 microversion: 2.1 time: 0.427167 Apr 13 17:47:52 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:47:51 2023] DELETE /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:52 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] Creating event network-changed:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:47:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055237 Apr 13 17:47:52 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 51/155] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:52 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:52 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772b5f3399f247d191e0f32d386ecea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d4b5316fa45838c82ce0a0cfbc3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:52 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0243764f-846b-4675-9ea1-49d07b05cdb5", "name": "network-vif-plugged", "status": "completed", "tag": "cb49c554-4ee4-463a-9556-318e3aae8a0f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-5cc5c599-a0cc-4077-a0af-f5264e8a5918 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c" status: 200 len: 1541 microversion: 2.1 time: 0.343062 Apr 13 17:47:52 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 54/156] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:52 2023] GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c => generated 1541 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:52 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ec48b39e-2529-43b6-b7ab-75970c24c539 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1540 microversion: 2.1 time: 0.258115 Apr 13 17:47:52 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:52 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1540 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] Creating event network-vif-plugged:cb49c554-4ee4-463a-9556-318e3aae8a0f for instance 0243764f-846b-4675-9ea1-49d07b05cdb5 on user Apr 13 17:47:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.436238 Apr 13 17:47:52 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 52/158] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:53 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9369ecf8-c786-47d2-a0eb-8cc9f3c7cce8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1540 microversion: 2.1 time: 0.692330 Apr 13 17:47:53 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 55/159] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:52 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1540 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:54 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcf221f-b53a-4e85-9743-ee10ab3c387c", "name": "network-vif-deleted", "tag": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:54 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] Creating event network-vif-deleted:cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance bfcf221f-b53a-4e85-9743-ee10ab3c387c on user Apr 13 17:47:54 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033321 Apr 13 17:47:54 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 53/160] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0243764f-846b-4675-9ea1-49d07b05cdb5", "name": "network-vif-plugged", "status": "completed", "tag": "cb49c554-4ee4-463a-9556-318e3aae8a0f"}, {"server_uuid": "bfcf221f-b53a-4e85-9743-ee10ab3c387c", "name": "network-vif-unplugged", "status": "completed", "tag": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e"}, {"server_uuid": "bfcf221f-b53a-4e85-9743-ee10ab3c387c", "name": "network-vif-plugged", "status": "completed", "tag": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:55 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Creating event network-vif-plugged:cb49c554-4ee4-463a-9556-318e3aae8a0f for instance 0243764f-846b-4675-9ea1-49d07b05cdb5 on user Apr 13 17:47:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Creating event network-vif-unplugged:cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance bfcf221f-b53a-4e85-9743-ee10ab3c387c on user Apr 13 17:47:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Creating event network-vif-plugged:cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance bfcf221f-b53a-4e85-9743-ee10ab3c387c on user Apr 13 17:47:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.039262 Apr 13 17:47:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:55 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:57 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:47:58 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5" status: 204 len: 0 microversion: 2.1 time: 0.252857 Apr 13 17:47:58 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 56/162] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:47:57 2023] DELETE /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:58 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c1cf6ba73c4adb9124f14d78f4ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a40fa0611d54d5b8a35fcc469fc5361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:47:58 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-74659bbc-f4f3-4c50-8307-c239e8ae48a9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5" status: 200 len: 1492 microversion: 2.1 time: 0.301712 Apr 13 17:47:58 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:47:58 2023] GET /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5 => generated 1492 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:47:58 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:58 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:58 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd435a8f-372c-4aab-81b0-a1f76658b5b5", "name": "network-vif-unplugged", "status": "completed", "tag": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:58 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:47:58 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] Creating event network-vif-unplugged:9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 on user Apr 13 17:47:58 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056005 Apr 13 17:47:58 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 54/164] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:47:59 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd435a8f-372c-4aab-81b0-a1f76658b5b5", "name": "network-vif-deleted", "tag": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:47:59 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:47:59 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:47:59 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:47:59 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] Creating event network-vif-deleted:9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 on user Apr 13 17:47:59 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031140 Apr 13 17:47:59 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 57/165] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:47:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:00 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd435a8f-372c-4aab-81b0-a1f76658b5b5", "name": "network-vif-plugged", "status": "completed", "tag": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:00 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] Creating event network-vif-plugged:9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 on user Apr 13 17:48:00 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028728 Apr 13 17:48:00 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 55/166] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ad6084b1-3650-4841-9077-2e92663b80b0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:05 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ad6084b1-3650-4841-9077-2e92663b80b0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad6084b1-3650-4841-9077-2e92663b80b0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad6084b1-3650-4841-9077-2e92663b80b0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad6084b1-3650-4841-9077-2e92663b80b0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad6084b1-3650-4841-9077-2e92663b80b0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad6084b1-3650-4841-9077-2e92663b80b0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad6084b1-3650-4841-9077-2e92663b80b0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ad6084b1-3650-4841-9077-2e92663b80b0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.085606 Apr 13 17:48:05 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:48:05 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-interface => generated 282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:06 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69605608-790d-49be-ab18-277549242bef", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] Creating event network-changed:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:48:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030852 Apr 13 17:48:06 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 58/168] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:06 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1608791842"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:06 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:07 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "POST /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/action" status: 202 len: 0 microversion: 2.1 time: 0.750029 Apr 13 17:48:07 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 56/169] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:48:06 2023] POST /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 17:48:07 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-be0b3d24-2383-44a8-a003-8c6262d5f4db tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '.version_select at 0x7f82e29b9fc0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:07 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-be0b3d24-2383-44a8-a003-8c6262d5f4db tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/images/ad21ab82-d8b1-45fb-a91a-338177c31b59" status: 200 len: 1611 microversion: 2.1 time: 0.048710 Apr 13 17:48:07 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 56/170] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 17:48:07 2023] GET /compute/v2.1/images/ad21ab82-d8b1-45fb-a91a-338177c31b59 => generated 1611 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:13 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-50629ec0-47f6-40a1-8a66-53c67f7c5f14 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:13 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-50629ec0-47f6-40a1-8a66-53c67f7c5f14 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50629ec0-47f6-40a1-8a66-53c67f7c5f14 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50629ec0-47f6-40a1-8a66-53c67f7c5f14 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50629ec0-47f6-40a1-8a66-53c67f7c5f14 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50629ec0-47f6-40a1-8a66-53c67f7c5f14 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50629ec0-47f6-40a1-8a66-53c67f7c5f14 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50629ec0-47f6-40a1-8a66-53c67f7c5f14 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:13 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-50629ec0-47f6-40a1-8a66-53c67f7c5f14 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098394 Apr 13 17:48:13 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 59/171] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:48:13 2023] GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-interface => generated 282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f8857e-9e9b-4a5a-912a-4d79014417d0", "tag": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:14 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] Creating event network-changed:965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 on user Apr 13 17:48:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034457 Apr 13 17:48:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 57/172] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-dcff00dc-3523-4bed-937c-0234d709a9f5 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:15 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-dcff00dc-3523-4bed-937c-0234d709a9f5 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dcff00dc-3523-4bed-937c-0234d709a9f5 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dcff00dc-3523-4bed-937c-0234d709a9f5 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dcff00dc-3523-4bed-937c-0234d709a9f5 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dcff00dc-3523-4bed-937c-0234d709a9f5 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dcff00dc-3523-4bed-937c-0234d709a9f5 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dcff00dc-3523-4bed-937c-0234d709a9f5 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-dcff00dc-3523-4bed-937c-0234d709a9f5 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.107778 Apr 13 17:48:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:48:15 2023] GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-interface => generated 282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "654c81b5-a7f6-4200-8896-6456816b08e3"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:16 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392047 Apr 13 17:48:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 60/174] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:48:16 2023] POST /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:16 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-4c2f0c8b-acba-49d1-93b9-8a9eb78f9e75 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:16 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-4c2f0c8b-acba-49d1-93b9-8a9eb78f9e75 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4c2f0c8b-acba-49d1-93b9-8a9eb78f9e75 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4c2f0c8b-acba-49d1-93b9-8a9eb78f9e75 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4c2f0c8b-acba-49d1-93b9-8a9eb78f9e75 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4c2f0c8b-acba-49d1-93b9-8a9eb78f9e75 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4c2f0c8b-acba-49d1-93b9-8a9eb78f9e75 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4c2f0c8b-acba-49d1-93b9-8a9eb78f9e75 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:16 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1b241a-4461-41d9-8890-012ddbda76df", "tag": "d6142a48-379f-470e-aaf0-a2dd0e626d72"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:16 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-4c2f0c8b-acba-49d1-93b9-8a9eb78f9e75 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.101970 Apr 13 17:48:16 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 58/175] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:48:16 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-interface => generated 283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:16 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] Creating event network-changed:d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance 1a1b241a-4461-41d9-8890-012ddbda76df on user Apr 13 17:48:16 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029914 Apr 13 17:48:16 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 58/176] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:18 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "732d0ada-deea-434c-a245-553c2994525f"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:18 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:18 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11", "tag": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] Creating event network-changed:0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 on user Apr 13 17:48:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030057 Apr 13 17:48:18 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 59/177] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:18 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aac82b6d-cb0d-4153-a7e1-8fd1be4167fb"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:18 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:18 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353731 Apr 13 17:48:18 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 61/178] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:48:18 2023] POST /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394594 Apr 13 17:48:18 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 59/179] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:48:18 2023] POST /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:22 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2de1cf65-7fac-45cc-a63f-97ceb7a675ce tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 200 len: 1537 microversion: 2.1 time: 0.180956 Apr 13 17:48:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 60/180] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:48:22 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 1537 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-60ea8921-e019-485b-8dd0-8019330c820f tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:25 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-60ea8921-e019-485b-8dd0-8019330c820f tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60ea8921-e019-485b-8dd0-8019330c820f tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60ea8921-e019-485b-8dd0-8019330c820f tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60ea8921-e019-485b-8dd0-8019330c820f tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60ea8921-e019-485b-8dd0-8019330c820f tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60ea8921-e019-485b-8dd0-8019330c820f tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60ea8921-e019-485b-8dd0-8019330c820f tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-60ea8921-e019-485b-8dd0-8019330c820f tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046326 Apr 13 17:48:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 62/181] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:25 2023] GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=12 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:25 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lazy-loading 'services' on Instance uuid 1a1b241a-4461-41d9-8890-012ddbda76df {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:48:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments/732d0ada-deea-434c-a245-553c2994525f" status: 202 len: 0 microversion: 2.1 time: 0.278713 Apr 13 17:48:25 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:48:25 2023] DELETE /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments/732d0ada-deea-434c-a245-553c2994525f => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6227fbde-d7c0-4cb3-9135-f22569af78d9"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] HTTP exception thrown: Volume 6227fbde-d7c0-4cb3-9135-f22569af78d9 could not be found. Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Request method failure captured: Apr 13 17:48:27 user devstack@n-api.service[61676]: request: PUT /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments/654c81b5-a7f6-4200-8896-6456816b08e3 HTTP/1.1 Apr 13 17:48:27 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:48:27 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:48:27 user devstack@n-api.service[61676]: Connection: close Apr 13 17:48:27 user devstack@n-api.service[61676]: Content-Length: 74 Apr 13 17:48:27 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:48:27 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:48:27 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:48:27 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_pFOGurPwNiGbPJuVuNOT-zEtalSN-7KqeKhIECtbrVggYt5paG9AmApL-9qakBZRQpIg6-hctH8yF05HFNhmGSkpYera3YjrfxOT1zLxuxq45t1IUpkfnMdGukGp_iGGdQ83rda4TdaBOSYAWOFZUENP7GKQWg8cMeVMQRARhbgU Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Project-Id: faf9221111ea4833b4e63d145be8ff6e Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Project-Name: tempest-VolumesAdminNegativeTest-629126418 Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Role: admin,member,reader Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Roles: admin,member,reader Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faf9221111ea4833b4e63d145be8ff6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faf9221111ea4833b4e63d145be8ff6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faf9221111ea4833b4e63d145be8ff6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Tenant: tempest-VolumesAdminNegativeTest-629126418 Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Tenant-Id: faf9221111ea4833b4e63d145be8ff6e Apr 13 17:48:27 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-629126418 Apr 13 17:48:27 user devstack@n-api.service[61676]: X-User: tempest-VolumesAdminNegativeTest-629126418-project-admin Apr 13 17:48:27 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:48:27 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:48:27 user devstack@n-api.service[61676]: X-User-Id: f2e40c33a06943c2b5b0e420fefbeadd Apr 13 17:48:27 user devstack@n-api.service[61676]: X-User-Name: tempest-VolumesAdminNegativeTest-629126418-project-admin Apr 13 17:48:27 user devstack@n-api.service[61676]: Apr 13 17:48:27 user devstack@n-api.service[61676]: {"volumeAttachment": {"volumeId": "6227fbde-d7c0-4cb3-9135-f22569af78d9"}} Apr 13 17:48:27 user devstack@n-api.service[61676]: method: > Apr 13 17:48:27 user devstack@n-api.service[61676]: exception: Volume 6227fbde-d7c0-4cb3-9135-f22569af78d9 could not be found. Apr 13 17:48:27 user devstack@n-api.service[61676]: action_args: {'server_id': '85f8857e-9e9b-4a5a-912a-4d79014417d0', 'id': '654c81b5-a7f6-4200-8896-6456816b08e3', 'body': {'volumeAttachment': {'volumeId': '6227fbde-d7c0-4cb3-9135-f22569af78d9'}}} Apr 13 17:48:27 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6227fbde-d7c0-4cb3-9135-f22569af78d9 could not be found. (HTTP 404) (Request-ID: req-3685a588-4692-468b-844b-729ccbd81ce1) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6227fbde-d7c0-4cb3-9135-f22569af78d9 could not be found. Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 6227fbde-d7c0-4cb3-9135-f22569af78d9 could not be found. Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6227fbde-d7c0-4cb3-9135-f22569af78d9 could not be found. Apr 13 17:48:27 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Returning 400 to user: Volume 6227fbde-d7c0-4cb3-9135-f22569af78d9 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:48:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-bdc0a4aa-e583-4b2b-809b-b60503e4420e tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments/654c81b5-a7f6-4200-8896-6456816b08e3" status: 400 len: 107 microversion: 2.1 time: 0.331872 Apr 13 17:48:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 61/183] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 17:48:27 2023] PUT /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments/654c81b5-a7f6-4200-8896-6456816b08e3 => generated 107 bytes in 333 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:48:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:27 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:27 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'services' on Instance uuid 85f8857e-9e9b-4a5a-912a-4d79014417d0 {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:48:28 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments/654c81b5-a7f6-4200-8896-6456816b08e3" status: 202 len: 0 microversion: 2.1 time: 0.276323 Apr 13 17:48:28 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 63/184] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:48:27 2023] DELETE /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments/654c81b5-a7f6-4200-8896-6456816b08e3 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9163ccf0-e2b7-4974-b7b6-3a24dc9eab56 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9163ccf0-e2b7-4974-b7b6-3a24dc9eab56 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9163ccf0-e2b7-4974-b7b6-3a24dc9eab56 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9163ccf0-e2b7-4974-b7b6-3a24dc9eab56 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9163ccf0-e2b7-4974-b7b6-3a24dc9eab56 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9163ccf0-e2b7-4974-b7b6-3a24dc9eab56 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9163ccf0-e2b7-4974-b7b6-3a24dc9eab56 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9163ccf0-e2b7-4974-b7b6-3a24dc9eab56 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9163ccf0-e2b7-4974-b7b6-3a24dc9eab56 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049982 Apr 13 17:48:28 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 61/185] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:28 2023] GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:28 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c0363571-bba1-467c-9eb5-2ccf2fcce817"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:28 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:28 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=16 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:28 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-92668b92-628e-40ff-a5ad-4e1a94f38e0c tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:28 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-92668b92-628e-40ff-a5ad-4e1a94f38e0c tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:28 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-92668b92-628e-40ff-a5ad-4e1a94f38e0c tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-92668b92-628e-40ff-a5ad-4e1a94f38e0c tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-92668b92-628e-40ff-a5ad-4e1a94f38e0c tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-92668b92-628e-40ff-a5ad-4e1a94f38e0c tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-92668b92-628e-40ff-a5ad-4e1a94f38e0c tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-92668b92-628e-40ff-a5ad-4e1a94f38e0c tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:28 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-92668b92-628e-40ff-a5ad-4e1a94f38e0c tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045489 Apr 13 17:48:28 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 64/186] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:28 2023] GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:48:28 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments/aac82b6d-cb0d-4153-a7e1-8fd1be4167fb" status: 202 len: 0 microversion: 2.1 time: 0.401646 Apr 13 17:48:28 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 62/187] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 17:48:28 2023] PUT /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments/aac82b6d-cb0d-4153-a7e1-8fd1be4167fb => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-3c7bb91c-7439-4294-b16e-75d1f29aa766 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:28 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-3c7bb91c-7439-4294-b16e-75d1f29aa766 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c7bb91c-7439-4294-b16e-75d1f29aa766 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c7bb91c-7439-4294-b16e-75d1f29aa766 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c7bb91c-7439-4294-b16e-75d1f29aa766 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c7bb91c-7439-4294-b16e-75d1f29aa766 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c7bb91c-7439-4294-b16e-75d1f29aa766 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c7bb91c-7439-4294-b16e-75d1f29aa766 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-3c7bb91c-7439-4294-b16e-75d1f29aa766 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048172 Apr 13 17:48:29 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 62/188] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:28 2023] GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:48:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:29 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:29 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:48:29 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df" status: 204 len: 0 microversion: 2.1 time: 0.111890 Apr 13 17:48:29 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 65/189] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:48:29 2023] DELETE /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:48:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:29 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:29 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f5fc6a5e3a54d619d57cb94bdb304c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900c1c4928514f198a3b630de0216b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:29 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-455bc701-0813-4eaf-9c7b-dab6d35491d9 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df" status: 200 len: 1673 microversion: 2.1 time: 0.170592 Apr 13 17:48:29 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 63/190] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:48:29 2023] GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1b241a-4461-41d9-8890-012ddbda76df", "name": "network-vif-unplugged", "status": "completed", "tag": "d6142a48-379f-470e-aaf0-a2dd0e626d72"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] Creating event network-vif-unplugged:d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance 1a1b241a-4461-41d9-8890-012ddbda76df on user Apr 13 17:48:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042687 Apr 13 17:48:29 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 63/191] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1b241a-4461-41d9-8890-012ddbda76df", "name": "network-vif-plugged", "status": "completed", "tag": "d6142a48-379f-470e-aaf0-a2dd0e626d72"}, {"server_uuid": "1a1b241a-4461-41d9-8890-012ddbda76df", "name": "network-vif-deleted", "tag": "d6142a48-379f-470e-aaf0-a2dd0e626d72"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] Creating event network-vif-plugged:d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance 1a1b241a-4461-41d9-8890-012ddbda76df on user Apr 13 17:48:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] Creating event network-vif-deleted:d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance 1a1b241a-4461-41d9-8890-012ddbda76df on user Apr 13 17:48:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034458 Apr 13 17:48:31 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 66/192] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:37 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:37 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-7802c801-afbc-4187-ba23-c52b074c1bb7 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5" status: 200 len: 1493 microversion: 2.1 time: 0.186022 Apr 13 17:48:37 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 64/193] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:48:37 2023] GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 => generated 1493 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=7 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-05b5fb69-8a09-4544-a75a-fad05146bb18 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-05b5fb69-8a09-4544-a75a-fad05146bb18 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05b5fb69-8a09-4544-a75a-fad05146bb18 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05b5fb69-8a09-4544-a75a-fad05146bb18 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05b5fb69-8a09-4544-a75a-fad05146bb18 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05b5fb69-8a09-4544-a75a-fad05146bb18 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05b5fb69-8a09-4544-a75a-fad05146bb18 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05b5fb69-8a09-4544-a75a-fad05146bb18 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:41 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-05b5fb69-8a09-4544-a75a-fad05146bb18 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049763 Apr 13 17:48:41 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 64/194] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:41 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:41 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:41 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:41 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-15b1bc90-228a-4eee-8242-061543e67b2b tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:41 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-15b1bc90-228a-4eee-8242-061543e67b2b tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15b1bc90-228a-4eee-8242-061543e67b2b tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15b1bc90-228a-4eee-8242-061543e67b2b tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15b1bc90-228a-4eee-8242-061543e67b2b tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15b1bc90-228a-4eee-8242-061543e67b2b tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15b1bc90-228a-4eee-8242-061543e67b2b tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15b1bc90-228a-4eee-8242-061543e67b2b tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-15b1bc90-228a-4eee-8242-061543e67b2b tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046962 Apr 13 17:48:42 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 67/195] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:41 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:48:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "aac82b6d-cb0d-4153-a7e1-8fd1be4167fb"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:42 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments/c0363571-bba1-467c-9eb5-2ccf2fcce817" status: 202 len: 0 microversion: 2.1 time: 0.279152 Apr 13 17:48:42 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 65/196] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 17:48:42 2023] PUT /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments/c0363571-bba1-467c-9eb5-2ccf2fcce817 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] HTTP exception thrown: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Request method failure captured: Apr 13 17:48:42 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c HTTP/1.1 Apr 13 17:48:42 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:48:42 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:48:42 user devstack@n-api.service[61678]: Connection: close Apr 13 17:48:42 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:48:42 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:48:42 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:48:42 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:48:42 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_ME67feLBHRa6Jyibl9LzGs5hwy_wvaXEbQIIXM11pqy7Dj8n5gso-1JTRZnA0gT1kUtwfSs1BuijREVie1P-XtjsC4tnTwNM0XlzWo8i172XhrLktUV7IJPK8vR_ol_A-wF9Ohk-ZJN9TRIsvLX3nqeXIvWzLfHdby2CchRFoc0Q Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Project-Id: 3f4d4b5316fa45838c82ce0a0cfbc3dc Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Project-Name: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Tenant: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Tenant-Id: 3f4d4b5316fa45838c82ce0a0cfbc3dc Apr 13 17:48:42 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:42 user devstack@n-api.service[61678]: X-User: tempest-DeleteServersTestJSON-492033592-project-member Apr 13 17:48:42 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:48:42 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:48:42 user devstack@n-api.service[61678]: X-User-Id: 772b5f3399f247d191e0f32d386ecea6 Apr 13 17:48:42 user devstack@n-api.service[61678]: X-User-Name: tempest-DeleteServersTestJSON-492033592-project-member Apr 13 17:48:42 user devstack@n-api.service[61678]: method: > Apr 13 17:48:42 user devstack@n-api.service[61678]: exception: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61678]: action_args: {'id': 'bfcf221f-b53a-4e85-9743-ee10ab3c387c'} Apr 13 17:48:42 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Returning 404 to user: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:48:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0f2c3373-dc03-4905-aaa0-26ae39a83285 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c" status: 404 len: 111 microversion: 2.1 time: 0.046925 Apr 13 17:48:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 65/197] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:48:42 2023] GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] HTTP exception thrown: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Request method failure captured: Apr 13 17:48:42 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c/os-volume_attachments HTTP/1.1 Apr 13 17:48:42 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:48:42 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:48:42 user devstack@n-api.service[61677]: Connection: close Apr 13 17:48:42 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:48:42 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:48:42 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:48:42 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:48:42 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_ME67feLBHRa6Jyibl9LzGs5hwy_wvaXEbQIIXM11pqy7Dj8n5gso-1JTRZnA0gT1kUtwfSs1BuijREVie1P-XtjsC4tnTwNM0XlzWo8i172XhrLktUV7IJPK8vR_ol_A-wF9Ohk-ZJN9TRIsvLX3nqeXIvWzLfHdby2CchRFoc0Q Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Project-Id: 3f4d4b5316fa45838c82ce0a0cfbc3dc Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Project-Name: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Tenant: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Tenant-Id: 3f4d4b5316fa45838c82ce0a0cfbc3dc Apr 13 17:48:42 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:42 user devstack@n-api.service[61677]: X-User: tempest-DeleteServersTestJSON-492033592-project-member Apr 13 17:48:42 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:48:42 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:48:42 user devstack@n-api.service[61677]: X-User-Id: 772b5f3399f247d191e0f32d386ecea6 Apr 13 17:48:42 user devstack@n-api.service[61677]: X-User-Name: tempest-DeleteServersTestJSON-492033592-project-member Apr 13 17:48:42 user devstack@n-api.service[61677]: method: > Apr 13 17:48:42 user devstack@n-api.service[61677]: exception: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61677]: action_args: {'server_id': 'bfcf221f-b53a-4e85-9743-ee10ab3c387c'} Apr 13 17:48:42 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:48:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Returning 404 to user: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:48:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3596c81a-004b-4a4a-b444-712db3611e7e tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038250 Apr 13 17:48:42 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 68/198] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:42 2023] GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:48:43 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:43 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9237946e-68ca-42f9-9b47-c6e2d0112e45 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:43 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9237946e-68ca-42f9-9b47-c6e2d0112e45 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9237946e-68ca-42f9-9b47-c6e2d0112e45 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9237946e-68ca-42f9-9b47-c6e2d0112e45 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9237946e-68ca-42f9-9b47-c6e2d0112e45 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9237946e-68ca-42f9-9b47-c6e2d0112e45 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9237946e-68ca-42f9-9b47-c6e2d0112e45 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9237946e-68ca-42f9-9b47-c6e2d0112e45 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9237946e-68ca-42f9-9b47-c6e2d0112e45 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170/os-interface" status: 200 len: 1827 microversion: 2.42 time: 0.212629 Apr 13 17:48:43 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 66/199] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 17:48:43 2023] GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170/os-interface => generated 1827 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:48:43 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:43 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-95ecd748-dd15-4cde-9bb2-355ec4986138 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1659 microversion: 2.1 time: 0.357636 Apr 13 17:48:43 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 66/200] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:48:43 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1659 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:43 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:43 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:44 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-321e1dc1-c8e6-463c-aa31-b62f044f51d8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1659 microversion: 2.1 time: 0.204446 Apr 13 17:48:44 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 69/201] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:48:43 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1659 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "tag": "054f8815-c1d1-4b57-9018-a34c8e785b80"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] Creating event network-changed:054f8815-c1d1-4b57-9018-a34c8e785b80 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038638 Apr 13 17:48:45 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 67/202] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] HTTP exception thrown: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Request method failure captured: Apr 13 17:48:45 user devstack@n-api.service[61676]: request: DELETE /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c HTTP/1.1 Apr 13 17:48:45 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:48:45 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:48:45 user devstack@n-api.service[61676]: Connection: close Apr 13 17:48:45 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:48:45 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:48:45 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:48:45 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:48:45 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_ME67feLBHRa6Jyibl9LzGs5hwy_wvaXEbQIIXM11pqy7Dj8n5gso-1JTRZnA0gT1kUtwfSs1BuijREVie1P-XtjsC4tnTwNM0XlzWo8i172XhrLktUV7IJPK8vR_ol_A-wF9Ohk-ZJN9TRIsvLX3nqeXIvWzLfHdby2CchRFoc0Q Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Project-Id: 3f4d4b5316fa45838c82ce0a0cfbc3dc Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Project-Name: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Tenant: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Tenant-Id: 3f4d4b5316fa45838c82ce0a0cfbc3dc Apr 13 17:48:45 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:45 user devstack@n-api.service[61676]: X-User: tempest-DeleteServersTestJSON-492033592-project-member Apr 13 17:48:45 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:48:45 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:48:45 user devstack@n-api.service[61676]: X-User-Id: 772b5f3399f247d191e0f32d386ecea6 Apr 13 17:48:45 user devstack@n-api.service[61676]: X-User-Name: tempest-DeleteServersTestJSON-492033592-project-member Apr 13 17:48:45 user devstack@n-api.service[61676]: method: > Apr 13 17:48:45 user devstack@n-api.service[61676]: exception: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61676]: action_args: {'id': 'bfcf221f-b53a-4e85-9743-ee10ab3c387c'} Apr 13 17:48:45 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Returning 404 to user: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:48:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-109235f9-87ed-4d8a-9ee0-5910a2b16c18 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c" status: 404 len: 111 microversion: 2.1 time: 0.045639 Apr 13 17:48:45 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 67/203] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:48:45 2023] DELETE /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] HTTP exception thrown: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Request method failure captured: Apr 13 17:48:45 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c HTTP/1.1 Apr 13 17:48:45 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:48:45 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:48:45 user devstack@n-api.service[61678]: Connection: close Apr 13 17:48:45 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:48:45 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:48:45 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:48:45 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:48:45 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_ME67feLBHRa6Jyibl9LzGs5hwy_wvaXEbQIIXM11pqy7Dj8n5gso-1JTRZnA0gT1kUtwfSs1BuijREVie1P-XtjsC4tnTwNM0XlzWo8i172XhrLktUV7IJPK8vR_ol_A-wF9Ohk-ZJN9TRIsvLX3nqeXIvWzLfHdby2CchRFoc0Q Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Project-Id: 3f4d4b5316fa45838c82ce0a0cfbc3dc Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Project-Name: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f4d4b5316fa45838c82ce0a0cfbc3dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Tenant: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Tenant-Id: 3f4d4b5316fa45838c82ce0a0cfbc3dc Apr 13 17:48:45 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-DeleteServersTestJSON-492033592 Apr 13 17:48:45 user devstack@n-api.service[61678]: X-User: tempest-DeleteServersTestJSON-492033592-project-member Apr 13 17:48:45 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:48:45 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:48:45 user devstack@n-api.service[61678]: X-User-Id: 772b5f3399f247d191e0f32d386ecea6 Apr 13 17:48:45 user devstack@n-api.service[61678]: X-User-Name: tempest-DeleteServersTestJSON-492033592-project-member Apr 13 17:48:45 user devstack@n-api.service[61678]: method: > Apr 13 17:48:45 user devstack@n-api.service[61678]: exception: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61678]: action_args: {'id': 'bfcf221f-b53a-4e85-9743-ee10ab3c387c'} Apr 13 17:48:45 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. Apr 13 17:48:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:48:45 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Returning 404 to user: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:48:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-348e5543-246f-4d6b-ab00-ad4ce6a9c9f3 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c" status: 404 len: 111 microversion: 2.1 time: 0.042972 Apr 13 17:48:45 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 68/204] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:48:45 2023] GET /compute/v2.1/servers/bfcf221f-b53a-4e85-9743-ee10ab3c387c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:45 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:45 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9b1423ae-d725-4820-9dba-ecd2f6ab414f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170" status: 200 len: 2823 microversion: 2.42 time: 0.326934 Apr 13 17:48:45 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 70/205] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:48:45 2023] GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 => generated 2823 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-bfe2018f-b5ab-4107-bfdd-9d943e5ad9ab tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-bfe2018f-b5ab-4107-bfdd-9d943e5ad9ab tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bfe2018f-b5ab-4107-bfdd-9d943e5ad9ab tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bfe2018f-b5ab-4107-bfdd-9d943e5ad9ab tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bfe2018f-b5ab-4107-bfdd-9d943e5ad9ab tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bfe2018f-b5ab-4107-bfdd-9d943e5ad9ab tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bfe2018f-b5ab-4107-bfdd-9d943e5ad9ab tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bfe2018f-b5ab-4107-bfdd-9d943e5ad9ab tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-bfe2018f-b5ab-4107-bfdd-9d943e5ad9ab tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170/os-interface" status: 200 len: 1827 microversion: 2.42 time: 0.254279 Apr 13 17:48:45 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 68/206] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 17:48:45 2023] GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170/os-interface => generated 1827 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:48:46 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:46 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:46 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:48:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170" status: 204 len: 0 microversion: 2.42 time: 0.147116 Apr 13 17:48:46 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 69/207] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 17:48:46 2023] DELETE /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 17:48:46 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:46 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:47 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c683b9e6-8f24-436a-8c35-c83b64ae355e tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:47 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c683b9e6-8f24-436a-8c35-c83b64ae355e tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c683b9e6-8f24-436a-8c35-c83b64ae355e tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c683b9e6-8f24-436a-8c35-c83b64ae355e tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c683b9e6-8f24-436a-8c35-c83b64ae355e tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c683b9e6-8f24-436a-8c35-c83b64ae355e tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c683b9e6-8f24-436a-8c35-c83b64ae355e tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c683b9e6-8f24-436a-8c35-c83b64ae355e tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:47 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:47 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:47 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:47 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-69ace977-bb28-4c30-8e19-23e42c961f97 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170" status: 200 len: 2948 microversion: 2.42 time: 0.260368 Apr 13 17:48:47 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 71/208] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:48:46 2023] GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 => generated 2948 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:48:47 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c683b9e6-8f24-436a-8c35-c83b64ae355e tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/os-interface" status: 200 len: 1827 microversion: 2.32 time: 0.257476 Apr 13 17:48:47 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 69/209] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 17:48:47 2023] GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/os-interface => generated 1827 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:48:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-unplugged", "status": "completed", "tag": "054f8815-c1d1-4b57-9018-a34c8e785b80"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] Creating event network-vif-unplugged:054f8815-c1d1-4b57-9018-a34c8e785b80 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044473 Apr 13 17:48:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 70/210] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:48 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-unplugged", "status": "completed", "tag": "7794066e-1eb8-4f57-b683-af981db15421"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:48 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] Creating event network-vif-unplugged:7794066e-1eb8-4f57-b683-af981db15421 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:48 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049098 Apr 13 17:48:48 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 72/211] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:48 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] HTTP exception thrown: Instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 could not be found. Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Request method failure captured: Apr 13 17:48:48 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5 HTTP/1.1 Apr 13 17:48:48 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:48:48 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:48:48 user devstack@n-api.service[61676]: Connection: close Apr 13 17:48:48 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:48:48 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:48:48 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:48:48 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:48:48 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_RusFvZ6cuIF7WzbTYiWpgNfG566CopVme1m4m2uxS0E7g48THelMEWUQGElvPNmIfePD-_XurefJZQeiVEBUnhMXDB8re92HxJsomkikRE1gqDEIWmFBhMLnlWIOTZsbqNdsvqHeP1VmmaYfZtOsDC_qUeCeuDLi2hQx56GErJn0 Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Project-Id: 8a40fa0611d54d5b8a35fcc469fc5361 Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Project-Name: tempest-VolumesActionsTest-1828433590 Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a40fa0611d54d5b8a35fcc469fc5361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a40fa0611d54d5b8a35fcc469fc5361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a40fa0611d54d5b8a35fcc469fc5361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Tenant: tempest-VolumesActionsTest-1828433590 Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Tenant-Id: 8a40fa0611d54d5b8a35fcc469fc5361 Apr 13 17:48:48 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-VolumesActionsTest-1828433590 Apr 13 17:48:48 user devstack@n-api.service[61676]: X-User: tempest-VolumesActionsTest-1828433590-project-member Apr 13 17:48:48 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:48:48 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:48:48 user devstack@n-api.service[61676]: X-User-Id: 75c1cf6ba73c4adb9124f14d78f4ac16 Apr 13 17:48:48 user devstack@n-api.service[61676]: X-User-Name: tempest-VolumesActionsTest-1828433590-project-member Apr 13 17:48:48 user devstack@n-api.service[61676]: method: > Apr 13 17:48:48 user devstack@n-api.service[61676]: exception: Instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 could not be found. Apr 13 17:48:48 user devstack@n-api.service[61676]: action_args: {'id': 'fd435a8f-372c-4aab-81b0-a1f76658b5b5'} Apr 13 17:48:48 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 could not be found. Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 could not be found. Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 could not be found. Apr 13 17:48:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:48:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Returning 404 to user: Instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:48:48 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a194de85-0648-401d-b98f-54e0b64389f9 tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5" status: 404 len: 111 microversion: 2.1 time: 0.063848 Apr 13 17:48:48 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 70/212] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:48:48 2023] GET /compute/v2.1/servers/fd435a8f-372c-4aab-81b0-a1f76658b5b5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:49 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "054f8815-c1d1-4b57-9018-a34c8e785b80"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-unplugged", "status": "completed", "tag": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-unplugged", "status": "completed", "tag": "f454a828-50c6-43ba-ae8b-f2b86adbde6d"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "f454a828-50c6-43ba-ae8b-f2b86adbde6d"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-unplugged", "status": "completed", "tag": "2968f077-89fd-47b8-b2d8-2be699130a08"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Creating event network-vif-plugged:054f8815-c1d1-4b57-9018-a34c8e785b80 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Creating event network-vif-unplugged:9dd21baf-0c87-4035-817b-3ecf6dad3ec1 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Creating event network-vif-plugged:9dd21baf-0c87-4035-817b-3ecf6dad3ec1 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Creating event network-vif-unplugged:f454a828-50c6-43ba-ae8b-f2b86adbde6d for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Creating event network-vif-plugged:f454a828-50c6-43ba-ae8b-f2b86adbde6d for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Creating event network-vif-unplugged:2968f077-89fd-47b8-b2d8-2be699130a08 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.054873 Apr 13 17:48:49 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 73/213] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:49 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:49 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f130ec09-5803-467f-aa7a-1cdbb5bc7e8f tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" status: 200 len: 2814 microversion: 2.32 time: 0.636471 Apr 13 17:48:49 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 71/214] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:48:49 2023] GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => generated 2814 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:48:49 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0bd8f669-b0c9-4aa4-9910-2d0b34f4ae0c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:49 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0bd8f669-b0c9-4aa4-9910-2d0b34f4ae0c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0bd8f669-b0c9-4aa4-9910-2d0b34f4ae0c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0bd8f669-b0c9-4aa4-9910-2d0b34f4ae0c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0bd8f669-b0c9-4aa4-9910-2d0b34f4ae0c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0bd8f669-b0c9-4aa4-9910-2d0b34f4ae0c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0bd8f669-b0c9-4aa4-9910-2d0b34f4ae0c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0bd8f669-b0c9-4aa4-9910-2d0b34f4ae0c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:50 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0bd8f669-b0c9-4aa4-9910-2d0b34f4ae0c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/os-interface" status: 200 len: 1827 microversion: 2.32 time: 0.237025 Apr 13 17:48:50 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 71/215] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 17:48:49 2023] GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/os-interface => generated 1827 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:48:50 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "7794066e-1eb8-4f57-b683-af981db15421"}, {"name": "network-changed", "server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "tag": "07509622-d164-4038-ba75-5bf6cd52d615"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Creating event network-vif-plugged:7794066e-1eb8-4f57-b683-af981db15421 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Creating event network-changed:07509622-d164-4038-ba75-5bf6cd52d615 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050459 Apr 13 17:48:50 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 74/216] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:50 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:51 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "2968f077-89fd-47b8-b2d8-2be699130a08"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-unplugged", "status": "completed", "tag": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-unplugged", "status": "completed", "tag": "365ecb91-8df1-419a-b559-ab5f41e6e38f"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-plugged", "status": "completed", "tag": "365ecb91-8df1-419a-b559-ab5f41e6e38f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Creating event network-vif-plugged:2968f077-89fd-47b8-b2d8-2be699130a08 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Creating event network-vif-unplugged:90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Creating event network-vif-plugged:90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Creating event network-vif-unplugged:365ecb91-8df1-419a-b559-ab5f41e6e38f for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Creating event network-vif-plugged:365ecb91-8df1-419a-b559-ab5f41e6e38f for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.070998 Apr 13 17:48:51 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 72/217] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:51 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:51 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:51 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:51 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:48:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" status: 204 len: 0 microversion: 2.32 time: 0.198905 Apr 13 17:48:52 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 72/218] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 17:48:51 2023] DELETE /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 17:48:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:52 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:53 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:53 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:53 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2e40f91d-3627-45d5-ac19-2bdc775f4adb tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" status: 200 len: 2939 microversion: 2.32 time: 1.276804 Apr 13 17:48:53 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 75/219] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:48:52 2023] GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => generated 2939 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 17:48:53 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:53 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] Creating event network-vif-unplugged:7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:53 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139549 Apr 13 17:48:53 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 73/220] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:53 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "07509622-d164-4038-ba75-5bf6cd52d615"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "07509622-d164-4038-ba75-5bf6cd52d615"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:53 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:53 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:53 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Creating event network-vif-unplugged:07509622-d164-4038-ba75-5bf6cd52d615 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Creating event network-vif-plugged:07509622-d164-4038-ba75-5bf6cd52d615 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Creating event network-vif-unplugged:fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.129474 Apr 13 17:48:53 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 73/221] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:53 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:55 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-deleted", "tag": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] Creating event network-vif-deleted:90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131010 Apr 13 17:48:55 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 76/222] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "8a952bca-a9c0-4f7b-a8d5-8639983809cf"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "8a952bca-a9c0-4f7b-a8d5-8639983809cf"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "c69b7013-5290-4bec-91d4-d1c86c94e982"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "c69b7013-5290-4bec-91d4-d1c86c94e982"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "4f9e9206-943a-43f9-a511-18ed9e8b8c40"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Creating event network-vif-plugged:7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Creating event network-vif-unplugged:8a952bca-a9c0-4f7b-a8d5-8639983809cf for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Creating event network-vif-plugged:8a952bca-a9c0-4f7b-a8d5-8639983809cf for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Creating event network-vif-unplugged:c69b7013-5290-4bec-91d4-d1c86c94e982 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Creating event network-vif-plugged:c69b7013-5290-4bec-91d4-d1c86c94e982 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Creating event network-vif-unplugged:4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.042141 Apr 13 17:48:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 74/223] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:55 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "09e76676-6015-4205-bd23-b86f896fb6d1"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "09e76676-6015-4205-bd23-b86f896fb6d1"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Creating event network-vif-plugged:fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Creating event network-vif-unplugged:09e76676-6015-4205-bd23-b86f896fb6d1 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Creating event network-vif-plugged:09e76676-6015-4205-bd23-b86f896fb6d1 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.054184 Apr 13 17:48:55 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 74/224] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-333358ff-56c5-4610-a1e5-0aa030da130a tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '.version_select at 0x7f82e2696050>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:57 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-333358ff-56c5-4610-a1e5-0aa030da130a tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/images/ad21ab82-d8b1-45fb-a91a-338177c31b59" status: 200 len: 1725 microversion: 2.1 time: 0.068917 Apr 13 17:48:57 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 77/225] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 17:48:57 2023] GET /compute/v2.1/images/ad21ab82-d8b1-45fb-a91a-338177c31b59 => generated 1725 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ea7d30cd-245a-4d89-bd21-9f3465d5cc06 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '.version_select at 0x7f82e26149d0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:57 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ea7d30cd-245a-4d89-bd21-9f3465d5cc06 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/images/ad21ab82-d8b1-45fb-a91a-338177c31b59" status: 200 len: 1725 microversion: 2.1 time: 0.057690 Apr 13 17:48:57 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 75/226] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 17:48:57 2023] GET /compute/v2.1/images/ad21ab82-d8b1-45fb-a91a-338177c31b59 => generated 1725 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7bcb330d-b6e6-4d76-b5b0-e1145e1202b2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-7bcb330d-b6e6-4d76-b5b0-e1145e1202b2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bcb330d-b6e6-4d76-b5b0-e1145e1202b2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bcb330d-b6e6-4d76-b5b0-e1145e1202b2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bcb330d-b6e6-4d76-b5b0-e1145e1202b2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bcb330d-b6e6-4d76-b5b0-e1145e1202b2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bcb330d-b6e6-4d76-b5b0-e1145e1202b2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bcb330d-b6e6-4d76-b5b0-e1145e1202b2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-7bcb330d-b6e6-4d76-b5b0-e1145e1202b2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050232 Apr 13 17:48:57 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 78/227] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:57 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-d91c30cb-97a7-4eb5-ac14-6aee164309a8 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-d91c30cb-97a7-4eb5-ac14-6aee164309a8 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d91c30cb-97a7-4eb5-ac14-6aee164309a8 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d91c30cb-97a7-4eb5-ac14-6aee164309a8 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d91c30cb-97a7-4eb5-ac14-6aee164309a8 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d91c30cb-97a7-4eb5-ac14-6aee164309a8 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d91c30cb-97a7-4eb5-ac14-6aee164309a8 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d91c30cb-97a7-4eb5-ac14-6aee164309a8 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbea54954e534fdc933b94936a47a0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a0fd6f48449a7ba8f9944243580b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:48:57 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-d91c30cb-97a7-4eb5-ac14-6aee164309a8 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Apr 13 17:48:57 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 76/228] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:57 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:57 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-9c9810ce-53ea-403e-9392-c0e20dc05dff tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef" status: 200 len: 1672 microversion: 2.1 time: 0.236355 Apr 13 17:48:57 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 75/229] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:48:57 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-deleted", "tag": "054f8815-c1d1-4b57-9018-a34c8e785b80"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] Creating event network-vif-deleted:054f8815-c1d1-4b57-9018-a34c8e785b80 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:57 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036859 Apr 13 17:48:57 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 79/230] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-plugged", "status": "completed", "tag": "4f9e9206-943a-43f9-a511-18ed9e8b8c40"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] Creating event network-vif-plugged:4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:57 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029658 Apr 13 17:48:57 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 76/231] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:57 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lazy-loading 'services' on Instance uuid fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:48:57 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments/aac82b6d-cb0d-4153-a7e1-8fd1be4167fb" status: 202 len: 0 microversion: 2.1 time: 0.209397 Apr 13 17:48:57 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 77/232] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:48:57 2023] DELETE /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments/aac82b6d-cb0d-4153-a7e1-8fd1be4167fb => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3e1a6fca-4fc1-4732-a629-1558fcde9a60 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3e1a6fca-4fc1-4732-a629-1558fcde9a60 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e1a6fca-4fc1-4732-a629-1558fcde9a60 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e1a6fca-4fc1-4732-a629-1558fcde9a60 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e1a6fca-4fc1-4732-a629-1558fcde9a60 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e1a6fca-4fc1-4732-a629-1558fcde9a60 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e1a6fca-4fc1-4732-a629-1558fcde9a60 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e1a6fca-4fc1-4732-a629-1558fcde9a60 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:58 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3e1a6fca-4fc1-4732-a629-1558fcde9a60 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072885 Apr 13 17:48:58 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 80/233] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:48:57 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:48:59 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-deleted", "tag": "2968f077-89fd-47b8-b2d8-2be699130a08"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-deleted", "tag": "7794066e-1eb8-4f57-b683-af981db15421"}, {"server_uuid": "ad14d742-a995-4eab-bc37-d04d3c20c170", "name": "network-vif-deleted", "tag": "365ecb91-8df1-419a-b559-ab5f41e6e38f"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-deleted", "tag": "4f9e9206-943a-43f9-a511-18ed9e8b8c40"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:48:59 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:48:59 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:48:59 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:48:59 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:48:59 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] Creating event network-vif-deleted:2968f077-89fd-47b8-b2d8-2be699130a08 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:59 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] Creating event network-vif-deleted:7794066e-1eb8-4f57-b683-af981db15421 for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:59 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] Creating event network-vif-deleted:365ecb91-8df1-419a-b559-ab5f41e6e38f for instance ad14d742-a995-4eab-bc37-d04d3c20c170 on user Apr 13 17:48:59 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] Creating event network-vif-deleted:4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:48:59 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.049651 Apr 13 17:48:59 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:48:59 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:01 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-b6da4fa5-2841-4082-9a4e-0bab15aa1a3a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'create', calling method: .version_select at 0x7f82e295f7f0>, body: {"keypair": {"name": "tempest-keypair-1430946118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw=="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:01 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-b6da4fa5-2841-4082-9a4e-0bab15aa1a3a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting quotas for project 5ee8ad9e1bc74eb9b9997f7706d3f096. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:49:01 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-b6da4fa5-2841-4082-9a4e-0bab15aa1a3a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting quotas for user 91769944ac8048dbb1f418d232e670d3 and project 5ee8ad9e1bc74eb9b9997f7706d3f096. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:49:01 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-b6da4fa5-2841-4082-9a4e-0bab15aa1a3a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182727 Apr 13 17:49:01 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 78/235] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:49:01 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:01 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-deleted", "tag": "09e76676-6015-4205-bd23-b86f896fb6d1"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-deleted", "tag": "07509622-d164-4038-ba75-5bf6cd52d615"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-deleted", "tag": "c69b7013-5290-4bec-91d4-d1c86c94e982"}, {"server_uuid": "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f", "name": "network-vif-deleted", "tag": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] Creating event network-vif-deleted:09e76676-6015-4205-bd23-b86f896fb6d1 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:49:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] Creating event network-vif-deleted:07509622-d164-4038-ba75-5bf6cd52d615 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:49:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] Creating event network-vif-deleted:c69b7013-5290-4bec-91d4-d1c86c94e982 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:49:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] Creating event network-vif-deleted:fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f on user Apr 13 17:49:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.033159 Apr 13 17:49:01 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 81/236] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:01 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:49:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1433621576", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "32c8d5d5-0fc7-4585-ab35-0b352781dc66"}], "security_groups": [{"name": "tempest-securitygroup--1320369332"}], "key_name": "tempest-keypair-1430946118", "user_data": "}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:03 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] validate_networks() for [('32c8d5d5-0fc7-4585-ab35-0b352781dc66', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting quotas for project 5ee8ad9e1bc74eb9b9997f7706d3f096. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting quotas for user 91769944ac8048dbb1f418d232e670d3 and project 5ee8ad9e1bc74eb9b9997f7706d3f096. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:49:04 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:49:04 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.729287 Apr 13 17:49:04 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 78/237] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:49:03 2023] POST /compute/v2.1/servers => generated 400 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:49:04 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8ebc673a-1915-44cc-b687-c732cc3602be tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:04 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-8ebc673a-1915-44cc-b687-c732cc3602be tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:04 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-8ebc673a-1915-44cc-b687-c732cc3602be tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-8ebc673a-1915-44cc-b687-c732cc3602be tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1232 microversion: 2.1 time: 0.069267 Apr 13 17:49:04 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 79/238] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:04 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1232 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:06 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] Creating event network-changed:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:49:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029602 Apr 13 17:49:06 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 82/239] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:08 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-plugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:08 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] Creating event network-vif-plugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:49:08 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041321 Apr 13 17:49:08 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 79/240] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:11 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-plugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:11 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] Creating event network-vif-plugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:49:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036696 Apr 13 17:49:11 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 80/241] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=30 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=58 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0082cf8a-0636-4166-83be-7fcb33c9162a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-0082cf8a-0636-4166-83be-7fcb33c9162a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0082cf8a-0636-4166-83be-7fcb33c9162a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0082cf8a-0636-4166-83be-7fcb33c9162a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0082cf8a-0636-4166-83be-7fcb33c9162a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0082cf8a-0636-4166-83be-7fcb33c9162a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0082cf8a-0636-4166-83be-7fcb33c9162a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0082cf8a-0636-4166-83be-7fcb33c9162a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:18 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-0082cf8a-0636-4166-83be-7fcb33c9162a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057248 Apr 13 17:49:18 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 83/242] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:49:18 2023] GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-509906458", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "78f8d90f-b42e-43ff-8216-42798f0b8a43"}]}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] validate_networks() for [('78f8d90f-b42e-43ff-8216-42798f0b8a43', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Getting quotas for project 2d6ea575d2574fcc99712adece6db415. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Getting quotas for user 5d77fa5340ce44099224f2f161af5ecc and project 2d6ea575d2574fcc99712adece6db415. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:49:18 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:49:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.557381 Apr 13 17:49:18 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 80/243] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:49:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:49:19 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:19 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-c920ef3b-ef7c-45ac-b506-544dc8e67be0 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:19 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-c920ef3b-ef7c-45ac-b506-544dc8e67be0 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:19 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:19 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-c920ef3b-ef7c-45ac-b506-544dc8e67be0 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d77fa5340ce44099224f2f161af5ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ea575d2574fcc99712adece6db415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:19 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-c920ef3b-ef7c-45ac-b506-544dc8e67be0 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" status: 200 len: 1211 microversion: 2.1 time: 0.079772 Apr 13 17:49:19 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 81/244] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:19 2023] GET /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:19 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] HTTP exception thrown: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Request method failure captured: Apr 13 17:49:19 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df HTTP/1.1 Apr 13 17:49:19 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:49:19 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:49:19 user devstack@n-api.service[61677]: Connection: close Apr 13 17:49:19 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:49:19 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:49:19 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:49:19 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:49:19 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_Gczk1Li_nPAVGTzjNKMxPPfWGHQrX6XoRU__ZM7JXYAlbeVY1nDKg6bRRwQnk8GPLwRZEq4DiCdiOb5Sylv9QfaTMRWFV-rDvByZe2pjxbShkljdvSPX2HoO1SoWmvNOKemSCHsBcAKuP6ojIg7vBtwiJ3F6gfgZg_vdn-HsEbwM Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Project-Id: 900c1c4928514f198a3b630de0216b60 Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-957875763 Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/900c1c4928514f198a3b630de0216b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/900c1c4928514f198a3b630de0216b60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/900c1c4928514f198a3b630de0216b60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-957875763 Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Tenant-Id: 900c1c4928514f198a3b630de0216b60 Apr 13 17:49:19 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-957875763 Apr 13 17:49:19 user devstack@n-api.service[61677]: X-User: tempest-AttachSCSIVolumeTestJSON-957875763-project-member Apr 13 17:49:19 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:49:19 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:49:19 user devstack@n-api.service[61677]: X-User-Id: 8f5fc6a5e3a54d619d57cb94bdb304c5 Apr 13 17:49:19 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-957875763-project-member Apr 13 17:49:19 user devstack@n-api.service[61677]: method: > Apr 13 17:49:19 user devstack@n-api.service[61677]: exception: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:19 user devstack@n-api.service[61677]: action_args: {'id': '1a1b241a-4461-41d9-8890-012ddbda76df'} Apr 13 17:49:19 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:19 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:19 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Returning 404 to user: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:49:19 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-36cfa181-8a34-4dc1-8187-0756c423902a tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df" status: 404 len: 111 microversion: 2.1 time: 0.049651 Apr 13 17:49:19 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 84/245] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:19 2023] GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:49:19 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1f7f586c-4f2c-412f-a172-bc25fa12b389 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '.version_select at 0x7f82e26a1a20>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:19 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1f7f586c-4f2c-412f-a172-bc25fa12b389 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143642649" status: 202 len: 0 microversion: 2.1 time: 0.026299 Apr 13 17:49:19 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 81/246] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 17:49:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143642649 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 17:49:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84", "tag": "919ef722-99b4-433d-9c37-e6ef30672421"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:21 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] Creating event network-changed:919ef722-99b4-433d-9c37-e6ef30672421 for instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 on user Apr 13 17:49:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044436 Apr 13 17:49:21 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 82/247] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] HTTP exception thrown: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Request method failure captured: Apr 13 17:49:22 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df HTTP/1.1 Apr 13 17:49:22 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:49:22 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:49:22 user devstack@n-api.service[61677]: Connection: close Apr 13 17:49:22 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:49:22 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:49:22 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:49:22 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:49:22 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_Gczk1Li_nPAVGTzjNKMxPPfWGHQrX6XoRU__ZM7JXYAlbeVY1nDKg6bRRwQnk8GPLwRZEq4DiCdiOb5Sylv9QfaTMRWFV-rDvByZe2pjxbShkljdvSPX2HoO1SoWmvNOKemSCHsBcAKuP6ojIg7vBtwiJ3F6gfgZg_vdn-HsEbwM Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Project-Id: 900c1c4928514f198a3b630de0216b60 Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-957875763 Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/900c1c4928514f198a3b630de0216b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/900c1c4928514f198a3b630de0216b60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/900c1c4928514f198a3b630de0216b60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-957875763 Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Tenant-Id: 900c1c4928514f198a3b630de0216b60 Apr 13 17:49:22 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-957875763 Apr 13 17:49:22 user devstack@n-api.service[61677]: X-User: tempest-AttachSCSIVolumeTestJSON-957875763-project-member Apr 13 17:49:22 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:49:22 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:49:22 user devstack@n-api.service[61677]: X-User-Id: 8f5fc6a5e3a54d619d57cb94bdb304c5 Apr 13 17:49:22 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-957875763-project-member Apr 13 17:49:22 user devstack@n-api.service[61677]: method: > Apr 13 17:49:22 user devstack@n-api.service[61677]: exception: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61677]: action_args: {'id': '1a1b241a-4461-41d9-8890-012ddbda76df'} Apr 13 17:49:22 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Returning 404 to user: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:49:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-13104f6e-ab98-4091-966c-a27eb9ff4916 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df" status: 404 len: 111 microversion: 2.1 time: 0.049985 Apr 13 17:49:22 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 85/248] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:49:22 2023] DELETE /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] HTTP exception thrown: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Request method failure captured: Apr 13 17:49:22 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df HTTP/1.1 Apr 13 17:49:22 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:49:22 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:49:22 user devstack@n-api.service[61676]: Connection: close Apr 13 17:49:22 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:49:22 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:49:22 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:49:22 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:49:22 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_Gczk1Li_nPAVGTzjNKMxPPfWGHQrX6XoRU__ZM7JXYAlbeVY1nDKg6bRRwQnk8GPLwRZEq4DiCdiOb5Sylv9QfaTMRWFV-rDvByZe2pjxbShkljdvSPX2HoO1SoWmvNOKemSCHsBcAKuP6ojIg7vBtwiJ3F6gfgZg_vdn-HsEbwM Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Project-Id: 900c1c4928514f198a3b630de0216b60 Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-957875763 Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/900c1c4928514f198a3b630de0216b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/900c1c4928514f198a3b630de0216b60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/900c1c4928514f198a3b630de0216b60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-957875763 Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Tenant-Id: 900c1c4928514f198a3b630de0216b60 Apr 13 17:49:22 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-957875763 Apr 13 17:49:22 user devstack@n-api.service[61676]: X-User: tempest-AttachSCSIVolumeTestJSON-957875763-project-member Apr 13 17:49:22 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:49:22 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:49:22 user devstack@n-api.service[61676]: X-User-Id: 8f5fc6a5e3a54d619d57cb94bdb304c5 Apr 13 17:49:22 user devstack@n-api.service[61676]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-957875763-project-member Apr 13 17:49:22 user devstack@n-api.service[61676]: method: > Apr 13 17:49:22 user devstack@n-api.service[61676]: exception: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61676]: action_args: {'id': '1a1b241a-4461-41d9-8890-012ddbda76df'} Apr 13 17:49:22 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. Apr 13 17:49:22 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Returning 404 to user: Instance 1a1b241a-4461-41d9-8890-012ddbda76df could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:49:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-45a535be-8823-4e6d-af54-4c5aa083ec46 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df" status: 404 len: 111 microversion: 2.1 time: 0.041330 Apr 13 17:49:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 82/249] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:22 2023] GET /compute/v2.1/servers/1a1b241a-4461-41d9-8890-012ddbda76df => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:49:22 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:22 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:23 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:23 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7e19862a-026a-4fc0-9447-062d999ac876 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 200 len: 1537 microversion: 2.1 time: 0.229814 Apr 13 17:49:23 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 83/250] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:22 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Searching by: {'deleted': False, 'project_id': '88bc3754064947c89397db4a80161b3a'} {{(pid=61677) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:23 user devstack@n-api.service[61677]: DEBUG nova.compute.multi_cell_list [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61677) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 17:49:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-026403d7-c9c8-46c6-a1f0-7292169b232e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.238738 Apr 13 17:49:23 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 86/251] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 17:49:23 2023] GET /compute/v2.1/servers => generated 340 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:23 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:23 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-5927ad02-cf1c-4a36-8ef4-1b0dde85d494 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 200 len: 1537 microversion: 2.1 time: 0.172787 Apr 13 17:49:23 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 83/252] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:23 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:24 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84", "name": "network-vif-plugged", "status": "completed", "tag": "919ef722-99b4-433d-9c37-e6ef30672421"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:24 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] Creating event network-vif-plugged:919ef722-99b4-433d-9c37-e6ef30672421 for instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 on user Apr 13 17:49:24 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042692 Apr 13 17:49:24 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 84/253] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db7bdb03-7472-4dd3-85ee-680fb0fe5d44"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:25 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315345 Apr 13 17:49:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 87/254] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:49:25 2023] POST /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:26 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84", "name": "network-vif-plugged", "status": "completed", "tag": "919ef722-99b4-433d-9c37-e6ef30672421"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] Creating event network-vif-plugged:919ef722-99b4-433d-9c37-e6ef30672421 for instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 on user Apr 13 17:49:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063408 Apr 13 17:49:26 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 84/255] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=9 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=10 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:35 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-96c58663-b940-4f85-9d5c-a8f3b672d173 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 200 len: 1583 microversion: 2.1 time: 0.227871 Apr 13 17:49:35 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 85/256] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:35 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 1583 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] HTTP exception thrown: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Request method failure captured: Apr 13 17:49:37 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 HTTP/1.1 Apr 13 17:49:37 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:49:37 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:49:37 user devstack@n-api.service[61677]: Connection: close Apr 13 17:49:37 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:49:37 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:49:37 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:49:37 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:49:37 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_MBjsPKmiDeNJt5JninPV1h27mFGMM7OVoFlHIQnf8Fx4MYPd8g3wMnTLynGcI3ytk5WItNP3EdqJniq1uUxG--7VPwjF3x-qgfF-uvSX07zp1pWvwjafKXBSQDxcxsh9VyBA-Uus6tbsehsIYppCId5349CX6YcP8umACWKtzPEc Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Project-Id: b192b3270576450b8c39368f07d1fae2 Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-354774172 Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b192b3270576450b8c39368f07d1fae2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b192b3270576450b8c39368f07d1fae2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b192b3270576450b8c39368f07d1fae2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Tenant: tempest-TaggedBootDevicesTest_v242-354774172 Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Tenant-Id: b192b3270576450b8c39368f07d1fae2 Apr 13 17:49:37 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-354774172 Apr 13 17:49:37 user devstack@n-api.service[61677]: X-User: tempest-TaggedBootDevicesTest_v242-354774172-project-member Apr 13 17:49:37 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:49:37 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:49:37 user devstack@n-api.service[61677]: X-User-Id: 4b46c336863a41f8a8429fdad30297a0 Apr 13 17:49:37 user devstack@n-api.service[61677]: X-User-Name: tempest-TaggedBootDevicesTest_v242-354774172-project-member Apr 13 17:49:37 user devstack@n-api.service[61677]: method: > Apr 13 17:49:37 user devstack@n-api.service[61677]: exception: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:37 user devstack@n-api.service[61677]: action_args: {'id': 'ad14d742-a995-4eab-bc37-d04d3c20c170'} Apr 13 17:49:37 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Returning 404 to user: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:49:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1c85fa99-4699-4fb2-a6cc-d43b2848af1c tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170" status: 404 len: 111 microversion: 2.42 time: 0.049459 Apr 13 17:49:37 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 88/257] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:49:37 2023] GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=11 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-d9aeca7c-95f4-4393-aa0d-e946abb0bf7a tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '.version_select at 0x7f82e26a1e10>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-d9aeca7c-95f4-4393-aa0d-e946abb0bf7a tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843115864" status: 204 len: 0 microversion: 2.42 time: 0.081527 Apr 13 17:49:37 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 85/258] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 17:49:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843115864 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 17:49:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:37 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:37 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] Creating event network-changed:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:49:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033517 Apr 13 17:49:37 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 89/259] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5" status: 204 len: 0 microversion: 2.1 time: 0.166114 Apr 13 17:49:37 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:49:37 2023] DELETE /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:38 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2b599a70-825c-4386-8a28-bc8d8e1c963a tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5" status: 200 len: 1499 microversion: 2.1 time: 0.506687 Apr 13 17:49:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 86/261] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:37 2023] GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 => generated 1499 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:39 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0243764f-846b-4675-9ea1-49d07b05cdb5", "name": "network-vif-unplugged", "status": "completed", "tag": "cb49c554-4ee4-463a-9556-318e3aae8a0f"}, {"server_uuid": "0243764f-846b-4675-9ea1-49d07b05cdb5", "name": "network-vif-plugged", "status": "completed", "tag": "cb49c554-4ee4-463a-9556-318e3aae8a0f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Creating event network-vif-unplugged:cb49c554-4ee4-463a-9556-318e3aae8a0f for instance 0243764f-846b-4675-9ea1-49d07b05cdb5 on user Apr 13 17:49:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Creating event network-vif-plugged:cb49c554-4ee4-463a-9556-318e3aae8a0f for instance 0243764f-846b-4675-9ea1-49d07b05cdb5 on user Apr 13 17:49:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046721 Apr 13 17:49:39 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 90/262] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-37e674a8-7673-4b7d-9b4b-ee8d4a727351 req-63247da1-9333-4ba4-a274-3f5015ffa5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0243764f-846b-4675-9ea1-49d07b05cdb5", "name": "network-vif-deleted", "tag": "cb49c554-4ee4-463a-9556-318e3aae8a0f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-37e674a8-7673-4b7d-9b4b-ee8d4a727351 req-63247da1-9333-4ba4-a274-3f5015ffa5de service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-37e674a8-7673-4b7d-9b4b-ee8d4a727351 req-63247da1-9333-4ba4-a274-3f5015ffa5de service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-37e674a8-7673-4b7d-9b4b-ee8d4a727351 req-63247da1-9333-4ba4-a274-3f5015ffa5de service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-37e674a8-7673-4b7d-9b4b-ee8d4a727351 req-63247da1-9333-4ba4-a274-3f5015ffa5de service nova] Creating event network-vif-deleted:cb49c554-4ee4-463a-9556-318e3aae8a0f for instance 0243764f-846b-4675-9ea1-49d07b05cdb5 on user Apr 13 17:49:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-37e674a8-7673-4b7d-9b4b-ee8d4a727351 req-63247da1-9333-4ba4-a274-3f5015ffa5de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059722 Apr 13 17:49:40 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 87/263] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1259821018", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "8d9da666-0149-44ad-8f19-8f10afceca63"}]}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:40 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] validate_networks() for [('8d9da666-0149-44ad-8f19-8f10afceca63', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting quotas for project d533287b8269447aab81fa7d1312d3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting quotas for user ec5fc9c7b7234904ba39d403764420b3 and project d533287b8269447aab81fa7d1312d3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:49:41 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:49:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.846089 Apr 13 17:49:41 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 87/264] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 17:49:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 17:49:41 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-44b172ea-3a76-42f5-9e70-3316bd98e9f2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:41 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-44b172ea-3a76-42f5-9e70-3316bd98e9f2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:41 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-44b172ea-3a76-42f5-9e70-3316bd98e9f2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:41 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-44b172ea-3a76-42f5-9e70-3316bd98e9f2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:41 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-44b172ea-3a76-42f5-9e70-3316bd98e9f2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:41 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-44b172ea-3a76-42f5-9e70-3316bd98e9f2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb" status: 200 len: 1395 microversion: 2.87 time: 0.089371 Apr 13 17:49:41 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 91/265] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:49:41 2023] GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb => generated 1395 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:49:41 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1534277652"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:41 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:41 user devstack@n-api.service[61678]: INFO nova.network.security_group_api [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Adding security group 7657ebf9-5630-4eed-8076-301eb21a5060 to port 7c1fde03-37b1-418b-8a56-9d046c05a1e0 Apr 13 17:49:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9253baac-4cd2-4d7c-bf38-9c257264353e tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/action" status: 202 len: 0 microversion: 2.1 time: 0.638515 Apr 13 17:49:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 88/266] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:49:41 2023] POST /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:49:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:42 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] Creating event network-changed:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:49:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033312 Apr 13 17:49:42 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 92/267] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:42 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-b733de71-df42-4e1f-8033-daa5eed0ba6c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 200 len: 1749 microversion: 2.1 time: 0.181384 Apr 13 17:49:42 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 88/268] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:42 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] HTTP exception thrown: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Request method failure captured: Apr 13 17:49:43 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f HTTP/1.1 Apr 13 17:49:43 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:49:43 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:49:43 user devstack@n-api.service[61678]: Connection: close Apr 13 17:49:43 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:49:43 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:49:43 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:49:43 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:49:43 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_KL2r5SqvW98UJn8Gy1_ojj-NPMyugjMDA6H9XXeecHoOnHqh3gJfezTTtkAle2oBz2HGiuX5FX0ilx2xIyjClASY2yeIvZgbhgwNq4P3FbwRe7GQgJYG4-gfNSyBNBafcb8V2egPWB7CkTCS8Dhyoj3_Zi8cstxGlLjQNregnC7w Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Project-Id: fff9543b4dea4fe094f886408bfa5865 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Project-Name: tempest-TaggedBootDevicesTest-1780397263 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fff9543b4dea4fe094f886408bfa5865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fff9543b4dea4fe094f886408bfa5865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fff9543b4dea4fe094f886408bfa5865"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Tenant: tempest-TaggedBootDevicesTest-1780397263 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Tenant-Id: fff9543b4dea4fe094f886408bfa5865 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1780397263 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User: tempest-TaggedBootDevicesTest-1780397263-project-member Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User-Id: c62d905cbf3043c28a2a0ad2cab40197 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User-Name: tempest-TaggedBootDevicesTest-1780397263-project-member Apr 13 17:49:43 user devstack@n-api.service[61678]: method: > Apr 13 17:49:43 user devstack@n-api.service[61678]: exception: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: action_args: {'id': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'} Apr 13 17:49:43 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Returning 404 to user: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:49:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-eb2cd5c2-4391-4dcc-a950-b211d533122c tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" status: 404 len: 111 microversion: 2.32 time: 0.030936 Apr 13 17:49:43 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 89/269] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:49:43 2023] GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:49:43 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-6c334b97-7657-4a95-855a-d76457d20e4d tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '.version_select at 0x7f82e26e93f0>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:43 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-6c334b97-7657-4a95-855a-d76457d20e4d tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897677956" status: 204 len: 0 microversion: 2.32 time: 0.056677 Apr 13 17:49:43 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 93/270] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 17:49:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897677956 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:43 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] HTTP exception thrown: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Request method failure captured: Apr 13 17:49:43 user devstack@n-api.service[61676]: request: DELETE /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 HTTP/1.1 Apr 13 17:49:43 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:49:43 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:49:43 user devstack@n-api.service[61676]: Connection: close Apr 13 17:49:43 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:49:43 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:49:43 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:49:43 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:49:43 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_MBjsPKmiDeNJt5JninPV1h27mFGMM7OVoFlHIQnf8Fx4MYPd8g3wMnTLynGcI3ytk5WItNP3EdqJniq1uUxG--7VPwjF3x-qgfF-uvSX07zp1pWvwjafKXBSQDxcxsh9VyBA-Uus6tbsehsIYppCId5349CX6YcP8umACWKtzPEc Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Project-Id: b192b3270576450b8c39368f07d1fae2 Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-354774172 Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b192b3270576450b8c39368f07d1fae2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b192b3270576450b8c39368f07d1fae2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b192b3270576450b8c39368f07d1fae2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Tenant: tempest-TaggedBootDevicesTest_v242-354774172 Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Tenant-Id: b192b3270576450b8c39368f07d1fae2 Apr 13 17:49:43 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-354774172 Apr 13 17:49:43 user devstack@n-api.service[61676]: X-User: tempest-TaggedBootDevicesTest_v242-354774172-project-member Apr 13 17:49:43 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:49:43 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:49:43 user devstack@n-api.service[61676]: X-User-Id: 4b46c336863a41f8a8429fdad30297a0 Apr 13 17:49:43 user devstack@n-api.service[61676]: X-User-Name: tempest-TaggedBootDevicesTest_v242-354774172-project-member Apr 13 17:49:43 user devstack@n-api.service[61676]: method: > Apr 13 17:49:43 user devstack@n-api.service[61676]: exception: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61676]: action_args: {'id': 'ad14d742-a995-4eab-bc37-d04d3c20c170'} Apr 13 17:49:43 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Returning 404 to user: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:49:43 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-303e1b3b-2cbe-47d3-bc4c-b4c9a48490b4 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170" status: 404 len: 111 microversion: 2.42 time: 0.035258 Apr 13 17:49:43 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 89/271] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 17:49:43 2023] DELETE /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] HTTP exception thrown: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Request method failure captured: Apr 13 17:49:43 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 HTTP/1.1 Apr 13 17:49:43 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:49:43 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:49:43 user devstack@n-api.service[61678]: Connection: close Apr 13 17:49:43 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:49:43 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:49:43 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:49:43 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:49:43 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_MBjsPKmiDeNJt5JninPV1h27mFGMM7OVoFlHIQnf8Fx4MYPd8g3wMnTLynGcI3ytk5WItNP3EdqJniq1uUxG--7VPwjF3x-qgfF-uvSX07zp1pWvwjafKXBSQDxcxsh9VyBA-Uus6tbsehsIYppCId5349CX6YcP8umACWKtzPEc Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Project-Id: b192b3270576450b8c39368f07d1fae2 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-354774172 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b192b3270576450b8c39368f07d1fae2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b192b3270576450b8c39368f07d1fae2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b192b3270576450b8c39368f07d1fae2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Tenant: tempest-TaggedBootDevicesTest_v242-354774172 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Tenant-Id: b192b3270576450b8c39368f07d1fae2 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-354774172 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User: tempest-TaggedBootDevicesTest_v242-354774172-project-member Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User-Id: 4b46c336863a41f8a8429fdad30297a0 Apr 13 17:49:43 user devstack@n-api.service[61678]: X-User-Name: tempest-TaggedBootDevicesTest_v242-354774172-project-member Apr 13 17:49:43 user devstack@n-api.service[61678]: method: > Apr 13 17:49:43 user devstack@n-api.service[61678]: exception: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: action_args: {'id': 'ad14d742-a995-4eab-bc37-d04d3c20c170'} Apr 13 17:49:43 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. Apr 13 17:49:43 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:49:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Returning 404 to user: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:49:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5036a01e-3782-4f13-ac77-cf0df63cc1a1 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170" status: 404 len: 111 microversion: 2.42 time: 0.041789 Apr 13 17:49:43 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 90/272] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:49:43 2023] GET /compute/v2.1/servers/ad14d742-a995-4eab-bc37-d04d3c20c170 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:49:44 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0dac50-5f78-406c-bd56-3d7cdf43d1cb", "tag": "ba1b3297-9105-4622-87e9-fdfa2daa7106"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] Creating event network-changed:ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb on user Apr 13 17:49:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032501 Apr 13 17:49:44 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 94/273] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:44 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:44 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:44 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/action" status: 202 len: 0 microversion: 2.1 time: 0.107677 Apr 13 17:49:44 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 90/274] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:49:44 2023] POST /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:49:44 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:44 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:44 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:44 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:44 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:44 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:44 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:44 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:44 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7a6f190f-b129-4c16-bd25-1ce53546dab1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 200 len: 1751 microversion: 2.1 time: 0.281000 Apr 13 17:49:45 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 91/275] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:44 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 1751 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:45 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:45 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:45 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:45 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-80a8aa09-7a17-42b7-858f-21062f75ad53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1659 microversion: 2.1 time: 0.239939 Apr 13 17:49:45 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 95/276] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:45 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1659 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c44732c-d2f2-4383-895a-8ac2aeddeff9"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:45 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:46 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457726 Apr 13 17:49:46 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 91/277] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:49:45 2023] POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "name": "network-vif-unplugged", "status": "completed", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] Creating event network-vif-unplugged:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:49:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034324 Apr 13 17:49:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 92/278] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:47 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:47 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:48 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] HTTP exception thrown: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Request method failure captured: Apr 13 17:49:48 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f HTTP/1.1 Apr 13 17:49:48 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:49:48 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:49:48 user devstack@n-api.service[61677]: Connection: close Apr 13 17:49:48 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:49:48 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:49:48 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:49:48 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:49:48 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_KL2r5SqvW98UJn8Gy1_ojj-NPMyugjMDA6H9XXeecHoOnHqh3gJfezTTtkAle2oBz2HGiuX5FX0ilx2xIyjClASY2yeIvZgbhgwNq4P3FbwRe7GQgJYG4-gfNSyBNBafcb8V2egPWB7CkTCS8Dhyoj3_Zi8cstxGlLjQNregnC7w Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Project-Id: fff9543b4dea4fe094f886408bfa5865 Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Project-Name: tempest-TaggedBootDevicesTest-1780397263 Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fff9543b4dea4fe094f886408bfa5865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fff9543b4dea4fe094f886408bfa5865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fff9543b4dea4fe094f886408bfa5865"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Tenant: tempest-TaggedBootDevicesTest-1780397263 Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Tenant-Id: fff9543b4dea4fe094f886408bfa5865 Apr 13 17:49:48 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1780397263 Apr 13 17:49:48 user devstack@n-api.service[61677]: X-User: tempest-TaggedBootDevicesTest-1780397263-project-member Apr 13 17:49:48 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:49:48 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:49:48 user devstack@n-api.service[61677]: X-User-Id: c62d905cbf3043c28a2a0ad2cab40197 Apr 13 17:49:48 user devstack@n-api.service[61677]: X-User-Name: tempest-TaggedBootDevicesTest-1780397263-project-member Apr 13 17:49:48 user devstack@n-api.service[61677]: method: > Apr 13 17:49:48 user devstack@n-api.service[61677]: exception: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61677]: action_args: {'id': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'} Apr 13 17:49:48 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Returning 404 to user: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:49:48 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-798b5e80-c7da-434a-960d-f1e39f70e926 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" status: 404 len: 111 microversion: 2.32 time: 0.037482 Apr 13 17:49:48 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 96/279] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 17:49:47 2023] DELETE /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:48 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] HTTP exception thrown: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Request method failure captured: Apr 13 17:49:48 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f HTTP/1.1 Apr 13 17:49:48 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:49:48 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:49:48 user devstack@n-api.service[61676]: Connection: close Apr 13 17:49:48 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:49:48 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:49:48 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:49:48 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:49:48 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_KL2r5SqvW98UJn8Gy1_ojj-NPMyugjMDA6H9XXeecHoOnHqh3gJfezTTtkAle2oBz2HGiuX5FX0ilx2xIyjClASY2yeIvZgbhgwNq4P3FbwRe7GQgJYG4-gfNSyBNBafcb8V2egPWB7CkTCS8Dhyoj3_Zi8cstxGlLjQNregnC7w Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Project-Id: fff9543b4dea4fe094f886408bfa5865 Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Project-Name: tempest-TaggedBootDevicesTest-1780397263 Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fff9543b4dea4fe094f886408bfa5865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fff9543b4dea4fe094f886408bfa5865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fff9543b4dea4fe094f886408bfa5865"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Tenant: tempest-TaggedBootDevicesTest-1780397263 Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Tenant-Id: fff9543b4dea4fe094f886408bfa5865 Apr 13 17:49:48 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1780397263 Apr 13 17:49:48 user devstack@n-api.service[61676]: X-User: tempest-TaggedBootDevicesTest-1780397263-project-member Apr 13 17:49:48 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:49:48 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:49:48 user devstack@n-api.service[61676]: X-User-Id: c62d905cbf3043c28a2a0ad2cab40197 Apr 13 17:49:48 user devstack@n-api.service[61676]: X-User-Name: tempest-TaggedBootDevicesTest-1780397263-project-member Apr 13 17:49:48 user devstack@n-api.service[61676]: method: > Apr 13 17:49:48 user devstack@n-api.service[61676]: exception: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61676]: action_args: {'id': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'} Apr 13 17:49:48 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. Apr 13 17:49:48 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Returning 404 to user: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:49:48 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-427318ae-6023-4da0-95ce-40676b23c258 tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" status: 404 len: 111 microversion: 2.32 time: 0.043423 Apr 13 17:49:48 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 92/280] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:49:48 2023] GET /compute/v2.1/servers/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 13 17:49:48 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-16f671c1-f25f-467a-8510-2625eb871945 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:48 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-16f671c1-f25f-467a-8510-2625eb871945 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-16f671c1-f25f-467a-8510-2625eb871945 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-16f671c1-f25f-467a-8510-2625eb871945 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-16f671c1-f25f-467a-8510-2625eb871945 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-16f671c1-f25f-467a-8510-2625eb871945 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-16f671c1-f25f-467a-8510-2625eb871945 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-16f671c1-f25f-467a-8510-2625eb871945 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:48 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-16f671c1-f25f-467a-8510-2625eb871945 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058379 Apr 13 17:49:48 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 93/281] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:49:48 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:48 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:49:48 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" status: 204 len: 0 microversion: 2.1 time: 0.121793 Apr 13 17:49:48 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 97/282] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:49:48 2023] DELETE /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:48 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023cacc072d43119d59765f0e0c5da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2125d26c69b434380ee15d03c9a196b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:48 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-265d2726-0ff4-439e-9efb-386f4e4233fc tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" status: 200 len: 1650 microversion: 2.1 time: 0.168757 Apr 13 17:49:48 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 93/283] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:48 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 => generated 1650 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:49 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "name": "network-vif-plugged", "status": "completed", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}, {"server_uuid": "db0dac50-5f78-406c-bd56-3d7cdf43d1cb", "name": "network-vif-plugged", "status": "completed", "tag": "ba1b3297-9105-4622-87e9-fdfa2daa7106"}, {"server_uuid": "db0dac50-5f78-406c-bd56-3d7cdf43d1cb", "name": "network-vif-plugged", "status": "completed", "tag": "ba1b3297-9105-4622-87e9-fdfa2daa7106"}, {"server_uuid": "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11", "name": "network-vif-unplugged", "status": "completed", "tag": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd"}, {"server_uuid": "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11", "name": "network-vif-plugged", "status": "completed", "tag": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Creating event network-vif-plugged:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:49:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Creating event network-vif-plugged:ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb on user Apr 13 17:49:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Creating event network-vif-plugged:ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb on user Apr 13 17:49:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Creating event network-vif-unplugged:0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 on user Apr 13 17:49:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Creating event network-vif-plugged:0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 on user Apr 13 17:49:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.047164 Apr 13 17:49:49 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 94/284] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:49 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:50 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11", "name": "network-vif-deleted", "tag": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] Creating event network-vif-deleted:0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 on user Apr 13 17:49:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031869 Apr 13 17:49:50 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 98/285] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:52 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "name": "network-vif-plugged", "status": "completed", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] Creating event network-vif-plugged:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:49:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050821 Apr 13 17:49:53 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 94/286] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:54 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:54 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-40cfe884-4551-4743-81c2-f8f53c54f1ff tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1539 microversion: 2.1 time: 0.194296 Apr 13 17:49:54 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 95/287] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:54 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1539 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "name": "network-vif-plugged", "status": "completed", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:55 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:55 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] Creating event network-vif-plugged:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:49:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058277 Apr 13 17:49:55 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 99/288] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:55 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-55349397-5877-417c-bd4e-37f88eb45cc8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1705 microversion: 2.1 time: 0.208527 Apr 13 17:49:55 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 95/289] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:55 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1705 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-127366011", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for project 71e743d5e6104b55b57b4754fe7e668a. Resources: dict_keys(['metadata_items']) {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for user 8f796555c0e242d091502725ec595c0f and project 71e743d5e6104b55b57b4754fe7e668a. Resources: dict_keys(['metadata_items']) {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/action" status: 202 len: 1159 microversion: 2.1 time: 0.470290 Apr 13 17:49:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 96/290] 10.0.0.210 () {64 vars in 1356 bytes} [Thu Apr 13 17:49:55 2023] POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/action => generated 1159 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:56 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:56 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-11fd3132-4267-4051-8338-b7f5cc1667dd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1732 microversion: 2.1 time: 0.286660 Apr 13 17:49:56 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 100/291] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:55 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1732 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:56 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-unplugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] Creating event network-vif-unplugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:49:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064324 Apr 13 17:49:56 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 96/292] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:49:58 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:49:58 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:49:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:58 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbea54954e534fdc933b94936a47a0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a0fd6f48449a7ba8f9944243580b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:49:58 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-6b28f06a-55f3-4329-bb34-f9f24248771d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef" status: 200 len: 1672 microversion: 2.1 time: 0.545019 Apr 13 17:49:58 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 97/293] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:49:58 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef => generated 1672 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:49:58 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:49:58 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:49:58 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:49:58 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:49:58 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:49:58 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069770 Apr 13 17:49:58 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 101/294] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:49:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:01 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ecd92a2-3a8e-4592-ab17-08f7c384c450"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:01 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:01 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "POST /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381940 Apr 13 17:50:01 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 97/295] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:50:01 2023] POST /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:08 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:08 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-787905959", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:08 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] validate_networks() for [('d619c2d2-220f-43dd-b31d-8f5d0254fc27', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:50:08 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:08 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:08 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:08 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:08 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:50:08 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037610 Apr 13 17:50:08 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 102/296] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:09 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "ad21ab82-d8b1-45fb-a91a-338177c31b59"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:09 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:50:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d77fa5340ce44099224f2f161af5ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ea575d2574fcc99712adece6db415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:09 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'flavor' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:50:09 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-825f52d7-1fe1-4a3a-b3c4-56ca94c6122a tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" status: 200 len: 1495 microversion: 2.1 time: 0.370095 Apr 13 17:50:09 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 98/297] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:50:09 2023] GET /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 => generated 1495 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting quotas for project c97ac3ae1ebe4107a05bd27710b9502b. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting quotas for user 8f1fe2e6fd894d5c87d7ccf5fae553ca and project c97ac3ae1ebe4107a05bd27710b9502b. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:50:09 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.419922 Apr 13 17:50:09 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 98/298] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:50:08 2023] POST /compute/v2.1/servers => generated 381 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3a13901f-6d52-418d-9edc-8328079c58ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-3a13901f-6d52-418d-9edc-8328079c58ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-3a13901f-6d52-418d-9edc-8328079c58ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:09 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-3a13901f-6d52-418d-9edc-8328079c58ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88" status: 200 len: 1215 microversion: 2.1 time: 0.065041 Apr 13 17:50:09 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 99/299] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:50:09 2023] GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1565904434", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:09 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] validate_networks() for [('d619c2d2-220f-43dd-b31d-8f5d0254fc27', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:50:09 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "POST /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/action" status: 200 len: 29 microversion: 2.1 time: 0.326170 Apr 13 17:50:09 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 103/300] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:50:09 2023] POST /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/action => generated 29 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:10 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbea54954e534fdc933b94936a47a0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a0fd6f48449a7ba8f9944243580b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:10 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-4f16fa63-37ea-4160-a6b5-cf4cf5af2f62 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef" status: 200 len: 1724 microversion: 2.1 time: 0.242834 Apr 13 17:50:10 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 100/301] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:50:09 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting quotas for project c97ac3ae1ebe4107a05bd27710b9502b. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting quotas for user 8f1fe2e6fd894d5c87d7ccf5fae553ca and project c97ac3ae1ebe4107a05bd27710b9502b. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:50:10 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:50:10 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.574658 Apr 13 17:50:10 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 99/302] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:50:09 2023] POST /compute/v2.1/servers => generated 381 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:50:10 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-89fba9ea-13dc-4abc-9b82-42e765e7a838 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:10 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-89fba9ea-13dc-4abc-9b82-42e765e7a838 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:10 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-89fba9ea-13dc-4abc-9b82-42e765e7a838 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:10 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-89fba9ea-13dc-4abc-9b82-42e765e7a838 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f" status: 200 len: 1216 microversion: 2.1 time: 0.076897 Apr 13 17:50:10 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 104/303] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:50:10 2023] GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:50:10 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:50:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032820 Apr 13 17:50:11 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 101/304] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:11 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-unplugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] Creating event network-vif-unplugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:50:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037677 Apr 13 17:50:11 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 100/305] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:13 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-plugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] Creating event network-vif-plugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:50:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032887 Apr 13 17:50:13 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 105/306] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] Creating event network-changed:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:50:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033969 Apr 13 17:50:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 102/307] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-plugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] Creating event network-vif-plugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:50:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049985 Apr 13 17:50:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 101/308] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] Creating event network-changed:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 17:50:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058408 Apr 13 17:50:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 106/309] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:17 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e7fd3fe9-9ca2-4495-982e-662d25d3c340 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'create', calling method: .version_select at 0x7f82e2520280>, body: {"keypair": {"name": "tempest-keypair-142800183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmqZOy7olKGfFEjGGEPUTWiwXJI6g8Pqj8VfYP7qUXA0qO+ggL6RxnieeiumVfVpIKABKlrT7FLRvV7y281BJMwrmjY6lnjk387cGRy7pkcY03EjqW+oukCEfTzjIpGsQ=="}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:17 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-e7fd3fe9-9ca2-4495-982e-662d25d3c340 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting quotas for project c3589c01630f4f83a6925d97943c574b. Resources: {'key_pairs'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:50:17 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-e7fd3fe9-9ca2-4495-982e-662d25d3c340 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting quotas for user 6be9926ecd1d45d89aba2e65ac3e0bfc and project c3589c01630f4f83a6925d97943c574b. Resources: {'key_pairs'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:50:17 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-e7fd3fe9-9ca2-4495-982e-662d25d3c340 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.109213 Apr 13 17:50:17 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 103/310] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 17:50:17 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 17:50:17 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-plugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}, {"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-plugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:17 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Creating event network-vif-plugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:50:17 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Creating event network-vif-plugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:50:17 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047638 Apr 13 17:50:17 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 102/311] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:18 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1379597542", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "41c99aae-50af-4003-92ae-c7c50e5f592d"}], "security_groups": [{"name": "tempest-securitygroup--1625593702"}], "key_name": "tempest-keypair-142800183", "user_data": "}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:18 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] validate_networks() for [('41c99aae-50af-4003-92ae-c7c50e5f592d', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:50:19 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "name": "network-vif-plugged", "status": "completed", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:19 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] Creating event network-vif-plugged:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 17:50:19 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046747 Apr 13 17:50:19 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 104/312] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting quotas for project c3589c01630f4f83a6925d97943c574b. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting quotas for user 6be9926ecd1d45d89aba2e65ac3e0bfc and project c3589c01630f4f83a6925d97943c574b. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:50:19 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:50:19 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.800639 Apr 13 17:50:19 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 107/313] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 17:50:18 2023] POST /compute/v2.1/servers => generated 400 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 17:50:19 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0a042bd8-8b42-4905-ab04-1ee75cf41474 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:19 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0a042bd8-8b42-4905-ab04-1ee75cf41474 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:19 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-0a042bd8-8b42-4905-ab04-1ee75cf41474 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:19 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-0a042bd8-8b42-4905-ab04-1ee75cf41474 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:19 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-0a042bd8-8b42-4905-ab04-1ee75cf41474 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:19 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0a042bd8-8b42-4905-ab04-1ee75cf41474 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 200 len: 1275 microversion: 2.20 time: 0.115730 Apr 13 17:50:19 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 103/314] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:50:19 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:50:19 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-plugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:19 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] Creating event network-vif-plugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:50:19 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057275 Apr 13 17:50:19 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 105/315] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "name": "network-vif-plugged", "status": "completed", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] Creating event network-vif-plugged:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 17:50:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049696 Apr 13 17:50:21 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 108/316] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:22 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:22 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] Creating event network-changed:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:50:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034715 Apr 13 17:50:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 104/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:25 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "name": "network-vif-plugged", "status": "completed", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:25 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] Creating event network-vif-plugged:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:50:25 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062845 Apr 13 17:50:25 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 106/318] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:50:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "name": "network-vif-plugged", "status": "completed", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] Creating event network-vif-plugged:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:50:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029404 Apr 13 17:50:27 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 109/319] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] HTTP exception thrown: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Request method failure captured: Apr 13 17:50:28 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 HTTP/1.1 Apr 13 17:50:28 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:50:28 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:50:28 user devstack@n-api.service[61678]: Connection: close Apr 13 17:50:28 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:50:28 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:50:28 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:50:28 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:50:28 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_RqbR01I-yaCp36KYOr-JDnHTiQpZVu80RD6rKwOqdSLxXFwjJ9OXC1r4y_CHnkg-q9E5AXdlVyThhG0yWYUdw9GAisEqk7eTWNIfdzvGJzWaKPc7M54q-RQVHH0rjTBorNtFw25dYyJ8_5pUVEDDw-91IG-HbMMD1V89Eyq_BXk8 Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Project-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Project-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Tenant: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Tenant-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:50:28 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:50:28 user devstack@n-api.service[61678]: X-User: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:50:28 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:50:28 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:50:28 user devstack@n-api.service[61678]: X-User-Id: b33d4309055340a4b42df540ca62d59f Apr 13 17:50:28 user devstack@n-api.service[61678]: X-User-Name: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:50:28 user devstack@n-api.service[61678]: method: > Apr 13 17:50:28 user devstack@n-api.service[61678]: exception: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:50:28 user devstack@n-api.service[61678]: action_args: {'id': '0243764f-846b-4675-9ea1-49d07b05cdb5'} Apr 13 17:50:28 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:50:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:50:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Returning 404 to user: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:50:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-c48dd02a-b3ab-49c3-a770-46e6aadf748c tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5" status: 404 len: 111 microversion: 2.1 time: 0.031740 Apr 13 17:50:28 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 105/320] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:50:28 2023] GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:28 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:28 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0fc2bc23-1725-4a09-b439-29ffbaeee85b tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b" status: 200 len: 1494 microversion: 2.1 time: 0.185902 Apr 13 17:50:28 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 107/321] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:50:28 2023] GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b => generated 1494 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=8 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:31 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1d388d5b-d62d-4c17-8e04-bcad01b52dd8 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb" status: 200 len: 1690 microversion: 2.87 time: 0.498436 Apr 13 17:50:31 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 110/322] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:50:31 2023] GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb => generated 1690 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=14 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:35 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ed4fa892-11ce-4444-b4cc-80c983dbce96 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 200 len: 1749 microversion: 2.1 time: 0.219948 Apr 13 17:50:35 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 106/323] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:50:35 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 1749 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] HTTP exception thrown: Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 could not be found. Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Request method failure captured: Apr 13 17:50:38 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 HTTP/1.1 Apr 13 17:50:38 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:50:38 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:50:38 user devstack@n-api.service[61676]: Connection: close Apr 13 17:50:38 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:50:38 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:50:38 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:50:38 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:50:38 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_KK6uWYD57IEq1oVkYiRcwK_I_9BGBo2Wcq1-PyydcmA85lfb0T6wjSj11o-yuvoGu9Omdo3dRzJS_9v3pOdEr9C6xLG0SdRHr7WNJWTHeeYVPAwpR4ponn2PqsdFy8fUcPYlJCpLGnPQdTHj05N9ki_PAxsTkggFR9cvS2wbAmzA Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Project-Id: c2125d26c69b434380ee15d03c9a196b Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Project-Name: tempest-TestVolumeSwap-197886889 Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c2125d26c69b434380ee15d03c9a196b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2125d26c69b434380ee15d03c9a196b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2125d26c69b434380ee15d03c9a196b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Tenant: tempest-TestVolumeSwap-197886889 Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Tenant-Id: c2125d26c69b434380ee15d03c9a196b Apr 13 17:50:38 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-TestVolumeSwap-197886889 Apr 13 17:50:38 user devstack@n-api.service[61676]: X-User: tempest-TestVolumeSwap-197886889-project-member Apr 13 17:50:38 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:50:38 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:50:38 user devstack@n-api.service[61676]: X-User-Id: 3023cacc072d43119d59765f0e0c5da7 Apr 13 17:50:38 user devstack@n-api.service[61676]: X-User-Name: tempest-TestVolumeSwap-197886889-project-member Apr 13 17:50:38 user devstack@n-api.service[61676]: method: > Apr 13 17:50:38 user devstack@n-api.service[61676]: exception: Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 could not be found. Apr 13 17:50:38 user devstack@n-api.service[61676]: action_args: {'id': 'fd2c1fea-4a6b-4ccb-956a-d67282ecbb11'} Apr 13 17:50:38 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 could not be found. Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 could not be found. Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 could not be found. Apr 13 17:50:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:50:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Returning 404 to user: Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:50:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-9a8c4283-a95a-4061-944b-1cdfef516f09 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" status: 404 len: 111 microversion: 2.1 time: 0.033861 Apr 13 17:50:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 108/324] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:50:38 2023] GET /compute/v2.1/servers/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:50:38 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7130af1a-f760-49ac-9978-880a3a40731c tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Calling method '.version_select at 0x7f82e26ebc70>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:38 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-7130af1a-f760-49ac-9978-880a3a40731c tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-573436766" status: 202 len: 0 microversion: 2.1 time: 0.022778 Apr 13 17:50:38 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 111/325] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 17:50:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-573436766 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=20 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:46 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:50:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-17d10eea-a91c-4910-9078-d851c260400f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1723 microversion: 2.1 time: 0.406403 Apr 13 17:50:46 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 107/326] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:50:46 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1723 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:50:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=29 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:52 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-02881bf9-6e85-4b98-87a7-93c0fca8f3c6 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Action: 'create', calling method: .version_select at 0x7f82e26a1240>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1397879856"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-02881bf9-6e85-4b98-87a7-93c0fca8f3c6 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.575278 Apr 13 17:50:53 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 109/327] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 13 17:50:52 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 577 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 17:50:53 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:53 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:53 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e523255a-cb9f-4f18-bccb-59d58321e371 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26969e0>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-e523255a-cb9f-4f18-bccb-59d58321e371 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 200 len: 345 microversion: 2.1 time: 0.058864 Apr 13 17:50:53 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 112/328] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:50:53 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-973e16b9-74ce-46e0-aa83-bd3f3a11632e tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26c4670>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-973e16b9-74ce-46e0-aa83-bd3f3a11632e tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 200 len: 346 microversion: 2.1 time: 0.056136 Apr 13 17:50:54 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 108/329] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:50:54 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:54 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-aae6aada-133d-47b9-93ef-0305ba93c0b2 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Action: 'create', calling method: .version_select at 0x7f82e25212d0>, body: {"snapshot": {"volume_id": "3ea72f2d-b8c5-4146-9820-c396f9893da9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1494135324"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:54 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-aae6aada-133d-47b9-93ef-0305ba93c0b2 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.146946 Apr 13 17:50:54 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 110/330] 10.0.0.210 () {64 vars in 1239 bytes} [Thu Apr 13 17:50:54 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:54 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-026a83a9-9bc6-4463-a048-69e7abbfce5a tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26ea5f0>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:54 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-026a83a9-9bc6-4463-a048-69e7abbfce5a tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576" status: 200 len: 287 microversion: 2.1 time: 0.038762 Apr 13 17:50:54 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 113/331] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 17:50:54 2023] GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-6bad5cc5-2e5d-4e4d-994b-2f758e22378d tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26c72e0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-6bad5cc5-2e5d-4e4d-994b-2f758e22378d tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064791 Apr 13 17:50:54 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 109/332] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 17:50:54 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:54 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1011a235-a91f-4984-8c99-e1b990d63d6e tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26a0dc0>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:54 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1011a235-a91f-4984-8c99-e1b990d63d6e tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576" status: 200 len: 287 microversion: 2.1 time: 0.035645 Apr 13 17:50:54 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 111/333] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 17:50:54 2023] GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:50:54 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7a045fcb-8567-44de-88c0-cc1a5f7f2314 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:54 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-7a045fcb-8567-44de-88c0-cc1a5f7f2314 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7a045fcb-8567-44de-88c0-cc1a5f7f2314 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7a045fcb-8567-44de-88c0-cc1a5f7f2314 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7a045fcb-8567-44de-88c0-cc1a5f7f2314 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7a045fcb-8567-44de-88c0-cc1a5f7f2314 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7a045fcb-8567-44de-88c0-cc1a5f7f2314 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7a045fcb-8567-44de-88c0-cc1a5f7f2314 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:54 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-7a045fcb-8567-44de-88c0-cc1a5f7f2314 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.115449 Apr 13 17:50:54 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 114/334] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:50:54 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/os-interface => generated 283 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7b682d15-15e1-4711-a0b5-114b7e44664c tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26c6200>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7b682d15-15e1-4711-a0b5-114b7e44664c tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576" status: 200 len: 287 microversion: 2.1 time: 0.032340 Apr 13 17:50:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 110/335] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 17:50:55 2023] GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:55 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] Creating event network-changed:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:50:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038644 Apr 13 17:50:55 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 112/336] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:50:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:55 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-25a87097-674f-4c9c-bd41-36132dbf68c4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:55 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-25a87097-674f-4c9c-bd41-36132dbf68c4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-25a87097-674f-4c9c-bd41-36132dbf68c4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-25a87097-674f-4c9c-bd41-36132dbf68c4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-25a87097-674f-4c9c-bd41-36132dbf68c4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-25a87097-674f-4c9c-bd41-36132dbf68c4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-25a87097-674f-4c9c-bd41-36132dbf68c4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-25a87097-674f-4c9c-bd41-36132dbf68c4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-25a87097-674f-4c9c-bd41-36132dbf68c4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/ips" status: 200 len: 105 microversion: 2.1 time: 0.036821 Apr 13 17:50:55 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 115/337] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 17:50:55 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/ips => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:56 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:56 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:50:56 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9ae2fc3e-7fb5-4fd2-876c-95efc5ddafe9 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e2570af0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:56 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9ae2fc3e-7fb5-4fd2-876c-95efc5ddafe9 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576" status: 200 len: 288 microversion: 2.1 time: 0.036496 Apr 13 17:50:56 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 111/338] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 17:50:56 2023] GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:56 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-692fd7da-892e-4650-8941-670645ac2fe8 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26a3910>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-692fd7da-892e-4650-8941-670645ac2fe8 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576" status: 202 len: 0 microversion: 2.1 time: 0.084747 Apr 13 17:50:56 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 113/339] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 13 17:50:56 2023] DELETE /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:50:56 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-cc652a1c-d8d6-476d-aaf9-d2b61511fe20 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e2697e20>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:56 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-cc652a1c-d8d6-476d-aaf9-d2b61511fe20 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576" status: 200 len: 287 microversion: 2.1 time: 0.038286 Apr 13 17:50:56 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 116/340] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 17:50:56 2023] GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:57 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "101df4ac-9f5e-4960-85e3-ccb7dc4be985"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:50:57 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:50:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:50:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:50:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:50:57 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284484 Apr 13 17:50:57 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 112/341] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:50:57 2023] POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:50:57 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-70412c63-0926-46ef-9be2-77f3e8559dfa tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e2522290>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:57 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-70412c63-0926-46ef-9be2-77f3e8559dfa tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576" status: 200 len: 287 microversion: 2.1 time: 0.032165 Apr 13 17:50:57 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 114/342] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 17:50:57 2023] GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:50:58 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-06c8f243-3458-4e2d-a1d1-af167a865837 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e241cb80>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:58 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-06c8f243-3458-4e2d-a1d1-af167a865837 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] HTTP exception thrown: Snapshot 2a80871c-c365-42e0-8f59-07b454e5c576 could not be found. Apr 13 17:50:58 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-06c8f243-3458-4e2d-a1d1-af167a865837 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Request method failure captured: Apr 13 17:50:58 user devstack@n-api.service[61677]: request: GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576 HTTP/1.1 Apr 13 17:50:58 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:50:58 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:50:58 user devstack@n-api.service[61677]: Connection: close Apr 13 17:50:58 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:50:58 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:50:58 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:50:58 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:50:58 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOED8Wtr0Rl6d9mdEm3bcR6SQF85Ft5X50f3WWM94DJlByOVvhnsCFG7E6IOY-uyN1nILLWgAzkJxE2FWvncwSLq9elk9hqWKb5RTb65JdhAL3wIUGIongbp_wow1foUFeGX-a9J7_eIQzDSIVYLvz8kBiASLSAt_nOXMIvO6BYsQXZQ Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Project-Id: b994758375f74f57a40cc6bb6dd4896e Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Tenant-Id: b994758375f74f57a40cc6bb6dd4896e Apr 13 17:50:58 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:50:58 user devstack@n-api.service[61677]: X-User: tempest-VolumesSnapshotsTestJSON-829578280-project-member Apr 13 17:50:58 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:50:58 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:50:58 user devstack@n-api.service[61677]: X-User-Id: 4a04caa698bd4905932e565808b426d7 Apr 13 17:50:58 user devstack@n-api.service[61677]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829578280-project-member Apr 13 17:50:58 user devstack@n-api.service[61677]: method: Apr 13 17:50:58 user devstack@n-api.service[61677]: exception: Snapshot 2a80871c-c365-42e0-8f59-07b454e5c576 could not be found. Apr 13 17:50:58 user devstack@n-api.service[61677]: action_args: {'id': '2a80871c-c365-42e0-8f59-07b454e5c576'} Apr 13 17:50:58 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2a80871c-c365-42e0-8f59-07b454e5c576 could not be found. (HTTP 404) (Request-ID: req-bcbd1814-1489-4b9c-b6cf-082a03166938) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2a80871c-c365-42e0-8f59-07b454e5c576 could not be found. Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2a80871c-c365-42e0-8f59-07b454e5c576 could not be found. Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2a80871c-c365-42e0-8f59-07b454e5c576 could not be found. Apr 13 17:50:58 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:50:58 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-06c8f243-3458-4e2d-a1d1-af167a865837 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Returning 404 to user: Snapshot 2a80871c-c365-42e0-8f59-07b454e5c576 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:50:58 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-06c8f243-3458-4e2d-a1d1-af167a865837 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576" status: 404 len: 111 microversion: 2.1 time: 0.039062 Apr 13 17:50:58 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 117/343] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 17:50:58 2023] GET /compute/v2.1/os-snapshots/2a80871c-c365-42e0-8f59-07b454e5c576 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:50:58 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5b4adca7-8c06-4b68-bf15-7985d047c8c8 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26c6f80>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:58 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5b4adca7-8c06-4b68-bf15-7985d047c8c8 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 202 len: 0 microversion: 2.1 time: 0.060585 Apr 13 17:50:58 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 113/344] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 17:50:58 2023] DELETE /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:50:58 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-48f7a7c6-c527-40b4-ac79-3d76b5afae34 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26a0700>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:50:58 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-48f7a7c6-c527-40b4-ac79-3d76b5afae34 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 200 len: 345 microversion: 2.1 time: 0.057393 Apr 13 17:50:58 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 115/345] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:50:58 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:00 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f3b95931-1b59-49c8-bfc7-e368272f3f6f tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e241d090>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:00 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f3b95931-1b59-49c8-bfc7-e368272f3f6f tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 200 len: 345 microversion: 2.1 time: 0.056818 Apr 13 17:51:00 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 118/346] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:51:00 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:00 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:00 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:00 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbea54954e534fdc933b94936a47a0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a0fd6f48449a7ba8f9944243580b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:00 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5ab4152e-413d-4cc5-811b-a5456a2ef421 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef" status: 200 len: 1704 microversion: 2.1 time: 0.174776 Apr 13 17:51:00 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 114/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:51:00 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef => generated 1704 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:51:00 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:00 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:00 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:00 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-646b41f6-c448-4250-a354-db8703ffab8e tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f" status: 200 len: 1503 microversion: 2.1 time: 0.167643 Apr 13 17:51:00 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 116/348] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:51:00 2023] GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:51:01 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3f88500e-7b66-43c9-ac02-e6a8003af000 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e241cf70>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3f88500e-7b66-43c9-ac02-e6a8003af000 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 200 len: 345 microversion: 2.1 time: 0.050227 Apr 13 17:51:01 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 119/349] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:51:01 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:02 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-e611dad0-61ae-450b-9af7-5972f52985cc tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26c48b0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-e611dad0-61ae-450b-9af7-5972f52985cc tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 200 len: 345 microversion: 2.1 time: 0.053210 Apr 13 17:51:02 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 115/350] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:51:02 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3ec7b898-3ff9-415d-94d2-430d977f20bc tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e2521900>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-3ec7b898-3ff9-415d-94d2-430d977f20bc tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 200 len: 345 microversion: 2.1 time: 0.056406 Apr 13 17:51:03 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 117/351] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:51:03 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:04 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-65a1d67d-8d78-4ebb-8221-6b70b42aef07 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e241d3f0>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-65a1d67d-8d78-4ebb-8221-6b70b42aef07 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 200 len: 345 microversion: 2.1 time: 0.048780 Apr 13 17:51:04 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 120/352] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:51:04 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-e6ca5b00-cbfe-4dc9-bbf9-15fd4a673860 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e2615750>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:05 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-e6ca5b00-cbfe-4dc9-bbf9-15fd4a673860 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] HTTP exception thrown: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-e6ca5b00-cbfe-4dc9-bbf9-15fd4a673860 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Request method failure captured: Apr 13 17:51:05 user devstack@n-api.service[61678]: request: GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 HTTP/1.1 Apr 13 17:51:05 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:51:05 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:51:05 user devstack@n-api.service[61678]: Connection: close Apr 13 17:51:05 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:51:05 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:51:05 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:51:05 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:51:05 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOED8Wtr0Rl6d9mdEm3bcR6SQF85Ft5X50f3WWM94DJlByOVvhnsCFG7E6IOY-uyN1nILLWgAzkJxE2FWvncwSLq9elk9hqWKb5RTb65JdhAL3wIUGIongbp_wow1foUFeGX-a9J7_eIQzDSIVYLvz8kBiASLSAt_nOXMIvO6BYsQXZQ Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Project-Id: b994758375f74f57a40cc6bb6dd4896e Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Tenant-Id: b994758375f74f57a40cc6bb6dd4896e Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User: tempest-VolumesSnapshotsTestJSON-829578280-project-member Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User-Id: 4a04caa698bd4905932e565808b426d7 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829578280-project-member Apr 13 17:51:05 user devstack@n-api.service[61678]: method: Apr 13 17:51:05 user devstack@n-api.service[61678]: exception: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61678]: action_args: {'id': '3ea72f2d-b8c5-4146-9820-c396f9893da9'} Apr 13 17:51:05 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. (HTTP 404) (Request-ID: req-a1e1db16-b26f-4dad-ac30-eba049f6c688) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-e6ca5b00-cbfe-4dc9-bbf9-15fd4a673860 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Returning 404 to user: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:51:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-e6ca5b00-cbfe-4dc9-bbf9-15fd4a673860 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 404 len: 109 microversion: 2.1 time: 0.035934 Apr 13 17:51:05 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 116/353] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:51:05 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7860f1a9-70d9-4e08-9fce-199336808709 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e241f370>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:05 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Going to try to stop instance {{(pid=61676) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 17:51:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-7860f1a9-70d9-4e08-9fce-199336808709 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] HTTP exception thrown: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7860f1a9-70d9-4e08-9fce-199336808709 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Request method failure captured: Apr 13 17:51:05 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 HTTP/1.1 Apr 13 17:51:05 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:51:05 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:51:05 user devstack@n-api.service[61677]: Connection: close Apr 13 17:51:05 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:51:05 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:51:05 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:51:05 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:51:05 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOED8Wtr0Rl6d9mdEm3bcR6SQF85Ft5X50f3WWM94DJlByOVvhnsCFG7E6IOY-uyN1nILLWgAzkJxE2FWvncwSLq9elk9hqWKb5RTb65JdhAL3wIUGIongbp_wow1foUFeGX-a9J7_eIQzDSIVYLvz8kBiASLSAt_nOXMIvO6BYsQXZQ Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Project-Id: b994758375f74f57a40cc6bb6dd4896e Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Tenant-Id: b994758375f74f57a40cc6bb6dd4896e Apr 13 17:51:05 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:51:05 user devstack@n-api.service[61677]: X-User: tempest-VolumesSnapshotsTestJSON-829578280-project-member Apr 13 17:51:05 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:51:05 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:51:05 user devstack@n-api.service[61677]: X-User-Id: 4a04caa698bd4905932e565808b426d7 Apr 13 17:51:05 user devstack@n-api.service[61677]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829578280-project-member Apr 13 17:51:05 user devstack@n-api.service[61677]: method: Apr 13 17:51:05 user devstack@n-api.service[61677]: exception: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61677]: action_args: {'id': '3ea72f2d-b8c5-4146-9820-c396f9893da9'} Apr 13 17:51:05 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. (HTTP 404) (Request-ID: req-67579b62-4f83-4e2a-9b5b-6cde4e1260ec) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7860f1a9-70d9-4e08-9fce-199336808709 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Returning 404 to user: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:51:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-7860f1a9-70d9-4e08-9fce-199336808709 tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 404 len: 109 microversion: 2.1 time: 0.048036 Apr 13 17:51:05 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 121/354] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 17:51:05 2023] DELETE /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:51:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9db17ca5-6529-48d3-82a5-c9685f386bcf tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Calling method '.version_select at 0x7f82e26c5fc0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/action" status: 202 len: 0 microversion: 2.1 time: 0.111494 Apr 13 17:51:05 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 118/355] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:51:05 2023] POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:51:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-9db17ca5-6529-48d3-82a5-c9685f386bcf tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] HTTP exception thrown: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9db17ca5-6529-48d3-82a5-c9685f386bcf tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Request method failure captured: Apr 13 17:51:05 user devstack@n-api.service[61678]: request: GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 HTTP/1.1 Apr 13 17:51:05 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:51:05 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:51:05 user devstack@n-api.service[61678]: Connection: close Apr 13 17:51:05 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:51:05 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:51:05 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:51:05 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:51:05 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOED8Wtr0Rl6d9mdEm3bcR6SQF85Ft5X50f3WWM94DJlByOVvhnsCFG7E6IOY-uyN1nILLWgAzkJxE2FWvncwSLq9elk9hqWKb5RTb65JdhAL3wIUGIongbp_wow1foUFeGX-a9J7_eIQzDSIVYLvz8kBiASLSAt_nOXMIvO6BYsQXZQ Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Project-Id: b994758375f74f57a40cc6bb6dd4896e Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b994758375f74f57a40cc6bb6dd4896e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Tenant-Id: b994758375f74f57a40cc6bb6dd4896e Apr 13 17:51:05 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829578280 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User: tempest-VolumesSnapshotsTestJSON-829578280-project-member Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User-Id: 4a04caa698bd4905932e565808b426d7 Apr 13 17:51:05 user devstack@n-api.service[61678]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829578280-project-member Apr 13 17:51:05 user devstack@n-api.service[61678]: method: Apr 13 17:51:05 user devstack@n-api.service[61678]: exception: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61678]: action_args: {'id': '3ea72f2d-b8c5-4146-9820-c396f9893da9'} Apr 13 17:51:05 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. (HTTP 404) (Request-ID: req-d15e064a-4c8e-4352-9686-180ddc0ff3fe) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. Apr 13 17:51:05 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:51:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9db17ca5-6529-48d3-82a5-c9685f386bcf tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] Returning 404 to user: Volume 3ea72f2d-b8c5-4146-9820-c396f9893da9 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:51:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9db17ca5-6529-48d3-82a5-c9685f386bcf tempest-VolumesSnapshotsTestJSON-829578280 tempest-VolumesSnapshotsTestJSON-829578280-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9" status: 404 len: 109 microversion: 2.1 time: 0.034936 Apr 13 17:51:05 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 117/356] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 17:51:05 2023] GET /compute/v2.1/os-volumes/3ea72f2d-b8c5-4146-9820-c396f9893da9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:05 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-ed1dafd2-bcad-4845-a77f-f909f6ea29f7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1714 microversion: 2.1 time: 0.340738 Apr 13 17:51:05 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 122/357] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:51:05 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1714 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:51:05 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-unplugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:06 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] Creating event network-vif-unplugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:51:06 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029234 Apr 13 17:51:06 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 119/358] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:08 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-plugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:08 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] Creating event network-vif-plugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:51:08 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 Apr 13 17:51:08 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 118/359] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:51:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:09 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:09 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3145deee-94dc-491e-a5e6-a9e8594b8ab1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 200 len: 1587 microversion: 2.20 time: 0.179028 Apr 13 17:51:09 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 123/360] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:51:09 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 1587 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a5735913-164c-4e56-86c7-f095f8faa067"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:10 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] HTTP exception thrown: Volume a2083272-0cf8-482c-a3e0-b25dd418692b could not be found. Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Request method failure captured: Apr 13 17:51:10 user devstack@n-api.service[61676]: request: PUT /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/os-volume_attachments/a2083272-0cf8-482c-a3e0-b25dd418692b HTTP/1.1 Apr 13 17:51:10 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:51:10 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:51:10 user devstack@n-api.service[61676]: Connection: close Apr 13 17:51:10 user devstack@n-api.service[61676]: Content-Length: 74 Apr 13 17:51:10 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:51:10 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:51:10 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:51:10 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_pFOGurPwNiGbPJuVuNOT-zEtalSN-7KqeKhIECtbrVggYt5paG9AmApL-9qakBZRQpIg6-hctH8yF05HFNhmGSkpYera3YjrfxOT1zLxuxq45t1IUpkfnMdGukGp_iGGdQ83rda4TdaBOSYAWOFZUENP7GKQWg8cMeVMQRARhbgU Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Project-Id: faf9221111ea4833b4e63d145be8ff6e Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Project-Name: tempest-VolumesAdminNegativeTest-629126418 Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Role: admin,member,reader Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Roles: admin,member,reader Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faf9221111ea4833b4e63d145be8ff6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faf9221111ea4833b4e63d145be8ff6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faf9221111ea4833b4e63d145be8ff6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Tenant: tempest-VolumesAdminNegativeTest-629126418 Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Tenant-Id: faf9221111ea4833b4e63d145be8ff6e Apr 13 17:51:10 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-629126418 Apr 13 17:51:10 user devstack@n-api.service[61676]: X-User: tempest-VolumesAdminNegativeTest-629126418-project-admin Apr 13 17:51:10 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:51:10 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:51:10 user devstack@n-api.service[61676]: X-User-Id: f2e40c33a06943c2b5b0e420fefbeadd Apr 13 17:51:10 user devstack@n-api.service[61676]: X-User-Name: tempest-VolumesAdminNegativeTest-629126418-project-admin Apr 13 17:51:10 user devstack@n-api.service[61676]: Apr 13 17:51:10 user devstack@n-api.service[61676]: {"volumeAttachment": {"volumeId": "a5735913-164c-4e56-86c7-f095f8faa067"}} Apr 13 17:51:10 user devstack@n-api.service[61676]: method: > Apr 13 17:51:10 user devstack@n-api.service[61676]: exception: Volume a2083272-0cf8-482c-a3e0-b25dd418692b could not be found. Apr 13 17:51:10 user devstack@n-api.service[61676]: action_args: {'server_id': 'bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84', 'id': 'a2083272-0cf8-482c-a3e0-b25dd418692b', 'body': {'volumeAttachment': {'volumeId': 'a5735913-164c-4e56-86c7-f095f8faa067'}}} Apr 13 17:51:10 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2083272-0cf8-482c-a3e0-b25dd418692b could not be found. (HTTP 404) (Request-ID: req-16589976-1e25-4e50-8f29-b1fc4d66d696) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2083272-0cf8-482c-a3e0-b25dd418692b could not be found. Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2083272-0cf8-482c-a3e0-b25dd418692b could not be found. Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2083272-0cf8-482c-a3e0-b25dd418692b could not be found. Apr 13 17:51:10 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:51:10 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] Returning 404 to user: Volume a2083272-0cf8-482c-a3e0-b25dd418692b could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:51:10 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-91777a81-872f-4dd2-aeab-57089ece869b tempest-VolumesAdminNegativeTest-629126418 tempest-VolumesAdminNegativeTest-629126418-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/os-volume_attachments/a2083272-0cf8-482c-a3e0-b25dd418692b" status: 404 len: 109 microversion: 2.1 time: 0.078601 Apr 13 17:51:10 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 120/361] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 17:51:10 2023] PUT /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/os-volume_attachments/a2083272-0cf8-482c-a3e0-b25dd418692b => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:51:13 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:13 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:13 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:51:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" status: 204 len: 0 microversion: 2.1 time: 0.132657 Apr 13 17:51:13 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 119/362] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:51:13 2023] DELETE /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:51:13 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:13 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:13 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d77fa5340ce44099224f2f161af5ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ea575d2574fcc99712adece6db415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-fe1b5951-6aec-4220-8c57-8c340409a051 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" status: 200 len: 1501 microversion: 2.1 time: 0.268440 Apr 13 17:51:13 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 124/363] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:51:13 2023] GET /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 => generated 1501 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:51:13 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84", "name": "network-vif-unplugged", "status": "completed", "tag": "919ef722-99b4-433d-9c37-e6ef30672421"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:13 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] Creating event network-vif-unplugged:919ef722-99b4-433d-9c37-e6ef30672421 for instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 on user Apr 13 17:51:13 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172277 Apr 13 17:51:13 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 121/364] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:16 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84", "name": "network-vif-plugged", "status": "completed", "tag": "919ef722-99b4-433d-9c37-e6ef30672421"}, {"server_uuid": "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84", "name": "network-vif-deleted", "tag": "919ef722-99b4-433d-9c37-e6ef30672421"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:16 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] Creating event network-vif-plugged:919ef722-99b4-433d-9c37-e6ef30672421 for instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 on user Apr 13 17:51:16 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] Creating event network-vif-deleted:919ef722-99b4-433d-9c37-e6ef30672421 for instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 on user Apr 13 17:51:16 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036794 Apr 13 17:51:16 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 120/365] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:51:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:23 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-c3b6f693-96eb-4230-92ee-72f942788571 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Action: 'create', calling method: .version_select at 0x7f82e2697370>, body: {"keypair": {"name": "tempest-TestShelveInstance-822246976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+7fvwpKiIT941SPCbdY9x4Jev0kmNw794zuyTRCpHksjAYtGwMPWm/1jEY16x/UTkRyA96KR24i+FrqltRAjlx3KlYCS1QyCMn13CUYjLuHW0Kxt41qWBnmQAfLfVj5A=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:23 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=11 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:23 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-c3b6f693-96eb-4230-92ee-72f942788571 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Getting quotas for project 1775be5ea4c540b0a67bfe3468fd5901. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:51:23 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-c3b6f693-96eb-4230-92ee-72f942788571 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Getting quotas for user 8b8e4096bfa5458b81aa51dc55394cb9 and project 1775be5ea4c540b0a67bfe3468fd5901. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:51:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-c3b6f693-96eb-4230-92ee-72f942788571 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.309705 Apr 13 17:51:23 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 125/366] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:51:22 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=12 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1107166628", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-822246976", "security_groups": [{"name": "tempest-secgroup-smoke-82098690"}], "networks": [{"uuid": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14"}], "block_device_mapping_v2": [{"uuid": "520be0ee-ea06-4b16-8773-a8d5b9e40c87", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] validate_networks() for [('ada8cd69-34be-4d1d-acc5-79e9d24f1c14', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Getting quotas for project 1775be5ea4c540b0a67bfe3468fd5901. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Getting quotas for user 8b8e4096bfa5458b81aa51dc55394cb9 and project 1775be5ea4c540b0a67bfe3468fd5901. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:51:27 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='520be0ee-ea06-4b16-8773-a8d5b9e40c87',volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:51:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.943575 Apr 13 17:51:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 122/367] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:51:27 2023] POST /compute/v2.1/servers => generated 402 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:51:28 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:28 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-59938a2a-53ff-4058-808d-8eecb133eb61 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:28 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-59938a2a-53ff-4058-808d-8eecb133eb61 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:28 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-59938a2a-53ff-4058-808d-8eecb133eb61 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8e4096bfa5458b81aa51dc55394cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1775be5ea4c540b0a67bfe3468fd5901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-59938a2a-53ff-4058-808d-8eecb133eb61 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 200 len: 1083 microversion: 2.1 time: 0.079330 Apr 13 17:51:28 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 121/368] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:51:27 2023] GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 1083 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:51:30 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=26 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ef33e665-39d7-47e1-aa19-40b0002f3e55 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-411075584", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "cfa716b5-5ceb-4fcf-adf7-2238990f6c0a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8"}]}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-ef33e665-39d7-47e1-aa19-40b0002f3e55 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] HTTP exception thrown: Block Device cfa716b5-5ceb-4fcf-adf7-2238990f6c0a is not bootable. Apr 13 17:51:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ef33e665-39d7-47e1-aa19-40b0002f3e55 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Request method failure captured: Apr 13 17:51:30 user devstack@n-api.service[61677]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 17:51:30 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:51:30 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:51:30 user devstack@n-api.service[61677]: Connection: close Apr 13 17:51:30 user devstack@n-api.service[61677]: Content-Length: 356 Apr 13 17:51:30 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:51:30 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:51:30 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:51:30 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_RqbR01I-yaCp36KYOr-JDnHTiQpZVu80RD6rKwOqdSLxXFwjJ9OXC1r4y_CHnkg-q9E5AXdlVyThhG0yWYUdw9GAisEqk7eTWNIfdzvGJzWaKPc7M54q-RQVHH0rjTBorNtFw25dYyJ8_5pUVEDDw-91IG-HbMMD1V89Eyq_BXk8 Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Project-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Project-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Tenant: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Tenant-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:51:30 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:51:30 user devstack@n-api.service[61677]: X-User: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:51:30 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:51:30 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:51:30 user devstack@n-api.service[61677]: X-User-Id: b33d4309055340a4b42df540ca62d59f Apr 13 17:51:30 user devstack@n-api.service[61677]: X-User-Name: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:51:30 user devstack@n-api.service[61677]: Apr 13 17:51:30 user devstack@n-api.service[61677]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-411075584", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "cfa716b5-5ceb-4fcf-adf7-2238990f6c0a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8"}]}} Apr 13 17:51:30 user devstack@n-api.service[61677]: method: > Apr 13 17:51:30 user devstack@n-api.service[61677]: exception: Block Device cfa716b5-5ceb-4fcf-adf7-2238990f6c0a is not bootable. Apr 13 17:51:30 user devstack@n-api.service[61677]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-411075584', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'cfa716b5-5ceb-4fcf-adf7-2238990f6c0a'}], 'networks': [{'uuid': '74134ba8-d8bf-4dbd-853e-3b5e62fad8e8'}]}}} Apr 13 17:51:30 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device cfa716b5-5ceb-4fcf-adf7-2238990f6c0a is not bootable. Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device cfa716b5-5ceb-4fcf-adf7-2238990f6c0a is not bootable. Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device cfa716b5-5ceb-4fcf-adf7-2238990f6c0a is not bootable. Apr 13 17:51:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:51:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ef33e665-39d7-47e1-aa19-40b0002f3e55 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Returning 400 to user: Block Device cfa716b5-5ceb-4fcf-adf7-2238990f6c0a is not bootable. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:51:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-ef33e665-39d7-47e1-aa19-40b0002f3e55 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.126900 Apr 13 17:51:30 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 126/369] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:51:30 2023] POST /compute/v2.1/servers => generated 110 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:51:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:30 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:30 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-7f801c7a-8dc3-46d6-9e7e-039d3ca7f082 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b" status: 200 len: 1494 microversion: 2.1 time: 0.274678 Apr 13 17:51:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 123/370] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:51:30 2023] GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b => generated 1494 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:51:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] Creating event network-changed:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:51:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059539 Apr 13 17:51:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 122/371] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:51:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1409387366"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:31 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/action" status: 202 len: 52 microversion: 2.87 time: 0.942330 Apr 13 17:51:32 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 127/372] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 17:51:31 2023] POST /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/action => generated 52 bytes in 945 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 17:51:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1534277652"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:35 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:35 user devstack@n-api.service[61676]: INFO nova.network.security_group_api [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Removing security group 7657ebf9-5630-4eed-8076-301eb21a5060 from port 7c1fde03-37b1-418b-8a56-9d046c05a1e0 Apr 13 17:51:36 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-98963fce-c620-4d90-812b-9543ef6b0678 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/action" status: 202 len: 0 microversion: 2.1 time: 0.607231 Apr 13 17:51:36 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 124/373] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:51:35 2023] POST /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:51:36 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:36 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] Creating event network-changed:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:51:36 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094177 Apr 13 17:51:36 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 123/374] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:51:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:37 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'services' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:51:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "name": "network-vif-plugged", "status": "completed", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] Creating event network-vif-plugged:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:51:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035495 Apr 13 17:51:37 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 125/375] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:51:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments/db7bdb03-7472-4dd3-85ee-680fb0fe5d44" status: 202 len: 0 microversion: 2.1 time: 0.243809 Apr 13 17:51:37 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 128/376] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:51:37 2023] DELETE /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments/db7bdb03-7472-4dd3-85ee-680fb0fe5d44 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:51:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-58ad022d-d2ef-4f48-a3fe-e31b22e73508 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:37 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-58ad022d-d2ef-4f48-a3fe-e31b22e73508 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58ad022d-d2ef-4f48-a3fe-e31b22e73508 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58ad022d-d2ef-4f48-a3fe-e31b22e73508 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58ad022d-d2ef-4f48-a3fe-e31b22e73508 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58ad022d-d2ef-4f48-a3fe-e31b22e73508 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58ad022d-d2ef-4f48-a3fe-e31b22e73508 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58ad022d-d2ef-4f48-a3fe-e31b22e73508 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-58ad022d-d2ef-4f48-a3fe-e31b22e73508 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061995 Apr 13 17:51:37 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 124/377] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:51:37 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:38 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-cd6816d3-98c1-4b95-95b4-28658afbc5ae tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb" status: 200 len: 1690 microversion: 2.87 time: 0.210263 Apr 13 17:51:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 126/378] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:51:38 2023] GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb => generated 1690 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:51:38 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:38 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] Creating event network-changed:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:51:38 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030754 Apr 13 17:51:38 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 129/379] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:51:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:39 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "name": "network-vif-plugged", "status": "completed", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:51:39 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] Creating event network-vif-plugged:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:51:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034365 Apr 13 17:51:39 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 125/380] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:51:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:51:46 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:46 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:46 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:46 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:46 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:46 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:46 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:46 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:46 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:46 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-50f60651-dd37-4a3f-be8c-e34c9b3441a5 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1723 microversion: 2.1 time: 0.269021 Apr 13 17:51:46 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 127/381] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:51:46 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:51:47 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:47 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:47 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f17c3701-6769-4393-aa81-8811b1f1767a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1723 microversion: 2.1 time: 0.175476 Apr 13 17:51:47 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 130/382] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:51:47 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=12 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=12 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:51:55 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:51:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-fdab1362-4714-4932-8700-7855c9af740a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1691 microversion: 2.1 time: 0.174799 Apr 13 17:51:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 126/383] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:51:55 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=26 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:00 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "POST /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/action" status: 202 len: 0 microversion: 2.1 time: 0.183426 Apr 13 17:52:00 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 128/384] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:52:00 2023] POST /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-96bcfa30-fe9a-4d2d-a35d-9083c9ca0962 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-96bcfa30-fe9a-4d2d-a35d-9083c9ca0962 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-96bcfa30-fe9a-4d2d-a35d-9083c9ca0962 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-96bcfa30-fe9a-4d2d-a35d-9083c9ca0962 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-96bcfa30-fe9a-4d2d-a35d-9083c9ca0962 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-96bcfa30-fe9a-4d2d-a35d-9083c9ca0962 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-96bcfa30-fe9a-4d2d-a35d-9083c9ca0962 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-96bcfa30-fe9a-4d2d-a35d-9083c9ca0962 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:00 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:00 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:00 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-96bcfa30-fe9a-4d2d-a35d-9083c9ca0962 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098382 Apr 13 17:52:00 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 131/385] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:52:00 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-interface => generated 282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:00 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:00 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'flavor' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:52:00 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f/action" status: 200 len: 32 microversion: 2.1 time: 0.138167 Apr 13 17:52:00 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 127/386] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:52:00 2023] POST /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f/action => generated 32 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:00 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:00 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-d9399bc0-d811-4bb1-a909-6b5dd7c6ef51 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f" status: 200 len: 1509 microversion: 2.1 time: 0.155543 Apr 13 17:52:00 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 129/387] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:52:00 2023] GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:52:01 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-unplugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] Creating event network-vif-unplugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:52:01 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096098 Apr 13 17:52:01 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 132/388] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:02 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "name": "network-vif-unplugged", "status": "completed", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] Creating event network-vif-unplugged:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 17:52:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041830 Apr 13 17:52:02 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 128/389] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] HTTP exception thrown: Instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 could not be found. Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Request method failure captured: Apr 13 17:52:03 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 HTTP/1.1 Apr 13 17:52:03 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:52:03 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:52:03 user devstack@n-api.service[61676]: Connection: close Apr 13 17:52:03 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:52:03 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:52:03 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:52:03 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:52:03 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_R4HvjRM5-YiXzyZKenoBB9zyt31omHT6GrmS-uYAIWDgPDPRWaw1Jw4De45JJvSMlfHZYddSXQFi8B4rhnk2IQ3WLaoK1vJ2cTl0rWDf2LCQsyi0UDzBgVY1IOwTLRduLvwtqyBTLJx3s4MHkqL7higjaSS3cNAWfbdOgxSE41mA Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Project-Id: 2d6ea575d2574fcc99712adece6db415 Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Project-Name: tempest-VolumesAdminNegativeTest-1540143869 Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d6ea575d2574fcc99712adece6db415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d6ea575d2574fcc99712adece6db415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d6ea575d2574fcc99712adece6db415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Tenant: tempest-VolumesAdminNegativeTest-1540143869 Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Tenant-Id: 2d6ea575d2574fcc99712adece6db415 Apr 13 17:52:03 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1540143869 Apr 13 17:52:03 user devstack@n-api.service[61676]: X-User: tempest-VolumesAdminNegativeTest-1540143869-project-member Apr 13 17:52:03 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:52:03 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:52:03 user devstack@n-api.service[61676]: X-User-Id: 5d77fa5340ce44099224f2f161af5ecc Apr 13 17:52:03 user devstack@n-api.service[61676]: X-User-Name: tempest-VolumesAdminNegativeTest-1540143869-project-member Apr 13 17:52:03 user devstack@n-api.service[61676]: method: > Apr 13 17:52:03 user devstack@n-api.service[61676]: exception: Instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 could not be found. Apr 13 17:52:03 user devstack@n-api.service[61676]: action_args: {'id': 'bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84'} Apr 13 17:52:03 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 could not be found. Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 could not be found. Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 could not be found. Apr 13 17:52:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:52:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Returning 404 to user: Instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:52:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-e97222b9-e011-43df-afcf-862603bb62c2 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" status: 404 len: 111 microversion: 2.1 time: 0.119058 Apr 13 17:52:03 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 130/390] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:52:03 2023] GET /compute/v2.1/servers/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:52:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69605608-790d-49be-ab18-277549242bef", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}, {"name": "network-changed", "server_uuid": "69605608-790d-49be-ab18-277549242bef", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}, {"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-plugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Creating event network-changed:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:52:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Creating event network-changed:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:52:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Creating event network-vif-plugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:52:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.038775 Apr 13 17:52:03 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 133/391] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:03 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:04 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "name": "network-vif-plugged", "status": "completed", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] Creating event network-vif-plugged:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 17:52:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048921 Apr 13 17:52:04 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 129/392] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:05 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-plugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}, {"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-plugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Creating event network-vif-plugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:52:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Creating event network-vif-plugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:52:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032976 Apr 13 17:52:05 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 131/393] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:06 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "name": "network-vif-plugged", "status": "completed", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}, {"server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "name": "network-vif-plugged", "status": "completed", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Creating event network-vif-plugged:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 17:52:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Creating event network-vif-plugged:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 17:52:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035845 Apr 13 17:52:06 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 134/394] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:07 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:07 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:07 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:52:07 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0" status: 204 len: 0 microversion: 2.1 time: 0.132434 Apr 13 17:52:07 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 130/395] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:52:07 2023] DELETE /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:52:07 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:07 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:07 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d77fa5340ce44099224f2f161af5ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ea575d2574fcc99712adece6db415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:07 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-db944346-1a94-4172-9e43-85d2dd3df53c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0" status: 200 len: 1667 microversion: 2.1 time: 0.203415 Apr 13 17:52:07 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 132/396] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:52:07 2023] GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0 => generated 1667 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:52:08 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f8857e-9e9b-4a5a-912a-4d79014417d0", "name": "network-vif-unplugged", "status": "completed", "tag": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c"}, {"server_uuid": "85f8857e-9e9b-4a5a-912a-4d79014417d0", "name": "network-vif-plugged", "status": "completed", "tag": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:08 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Creating event network-vif-unplugged:965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 on user Apr 13 17:52:08 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Creating event network-vif-plugged:965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 on user Apr 13 17:52:08 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033913 Apr 13 17:52:08 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 135/397] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:07 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:08 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f8857e-9e9b-4a5a-912a-4d79014417d0", "name": "network-vif-deleted", "tag": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:08 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] Creating event network-vif-deleted:965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 on user Apr 13 17:52:08 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031094 Apr 13 17:52:08 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 131/398] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:10 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ef28b998-34bb-421c-aded-e299771e59b1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:10 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ef28b998-34bb-421c-aded-e299771e59b1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef28b998-34bb-421c-aded-e299771e59b1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef28b998-34bb-421c-aded-e299771e59b1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef28b998-34bb-421c-aded-e299771e59b1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef28b998-34bb-421c-aded-e299771e59b1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef28b998-34bb-421c-aded-e299771e59b1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef28b998-34bb-421c-aded-e299771e59b1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:10 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ef28b998-34bb-421c-aded-e299771e59b1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.136856 Apr 13 17:52:10 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 133/399] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 17:52:10 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-interface => generated 282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:52:11 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] Creating event network-changed:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:52:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038632 Apr 13 17:52:11 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 136/400] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:11 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0d069215-cd9d-430d-89df-3589723f861d tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:11 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0d069215-cd9d-430d-89df-3589723f861d tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d069215-cd9d-430d-89df-3589723f861d tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d069215-cd9d-430d-89df-3589723f861d tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d069215-cd9d-430d-89df-3589723f861d tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d069215-cd9d-430d-89df-3589723f861d tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d069215-cd9d-430d-89df-3589723f861d tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d069215-cd9d-430d-89df-3589723f861d tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0d069215-cd9d-430d-89df-3589723f861d tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/ips" status: 200 len: 110 microversion: 2.20 time: 0.040437 Apr 13 17:52:11 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 132/401] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 17:52:11 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/ips => generated 110 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:52:13 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:13 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:13 user devstack@n-api.service[61676]: DEBUG nova.objects.instance [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'flavor' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=61676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:52:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/action" status: 202 len: 0 microversion: 2.20 time: 0.915112 Apr 13 17:52:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 134/402] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 17:52:13 2023] POST /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:14 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:14 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-b8b8ba22-2d48-4649-920a-8ff68c43cc2b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 200 len: 1712 microversion: 2.20 time: 0.259369 Apr 13 17:52:14 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 137/403] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:52:14 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 1712 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:52:14 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "name": "network-vif-unplugged", "status": "completed", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:14 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] Creating event network-vif-unplugged:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:52:14 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046111 Apr 13 17:52:14 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 133/404] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:16 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "name": "network-vif-plugged", "status": "completed", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:16 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] Creating event network-vif-plugged:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:52:16 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029098 Apr 13 17:52:16 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 135/405] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:18 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:18 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:18 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8e4096bfa5458b81aa51dc55394cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1775be5ea4c540b0a67bfe3468fd5901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:18 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-7580342d-10d0-4088-a7be-bdc644cd2b01 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 200 len: 1431 microversion: 2.1 time: 0.194786 Apr 13 17:52:18 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 138/406] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:52:18 2023] GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 1431 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:52:18 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] Creating event network-changed:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:52:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041775 Apr 13 17:52:18 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 134/407] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=16 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b702387d-6f5d-43e8-a0b2-0f7940c33cd6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b702387d-6f5d-43e8-a0b2-0f7940c33cd6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b702387d-6f5d-43e8-a0b2-0f7940c33cd6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b702387d-6f5d-43e8-a0b2-0f7940c33cd6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b702387d-6f5d-43e8-a0b2-0f7940c33cd6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b702387d-6f5d-43e8-a0b2-0f7940c33cd6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b702387d-6f5d-43e8-a0b2-0f7940c33cd6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b702387d-6f5d-43e8-a0b2-0f7940c33cd6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-b702387d-6f5d-43e8-a0b2-0f7940c33cd6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.181550 Apr 13 17:52:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 136/408] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:52:27 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] HTTP exception thrown: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 is not attached to volume db7bdb03-7472-4dd3-85ee-680fb0fe5d44 Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Request method failure captured: Apr 13 17:52:27 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments/db7bdb03-7472-4dd3-85ee-680fb0fe5d44 HTTP/1.1 Apr 13 17:52:27 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:52:27 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:52:27 user devstack@n-api.service[61677]: Connection: close Apr 13 17:52:27 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:52:27 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:52:27 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:52:27 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:52:27 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEAm-0TEb7fc9lKCwp4mctd_3n1ealIlOB4ivtqhBhcctijvaZAwLfT1X09Em1gdkDoX0-rzVa6aHsKeY_olXX2T6_c2W7PSLrVIvwxW4TXP1Y8hs0nGGQjrz0M7F8ibyBUJM1TELui1AX1BUNETGX2iVDbZqt0tU5TaIcZgNh74cVA Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Project-Id: 88bc3754064947c89397db4a80161b3a Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88bc3754064947c89397db4a80161b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88bc3754064947c89397db4a80161b3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88bc3754064947c89397db4a80161b3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Tenant: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Tenant-Id: 88bc3754064947c89397db4a80161b3a Apr 13 17:52:27 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:52:27 user devstack@n-api.service[61677]: X-User: tempest-TestMinimumBasicScenario-1587858147-project-member Apr 13 17:52:27 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:52:27 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:52:27 user devstack@n-api.service[61677]: X-User-Id: 8bdac67b9cc149b4b802c96fc87fc801 Apr 13 17:52:27 user devstack@n-api.service[61677]: X-User-Name: tempest-TestMinimumBasicScenario-1587858147-project-member Apr 13 17:52:27 user devstack@n-api.service[61677]: method: > Apr 13 17:52:27 user devstack@n-api.service[61677]: exception: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 is not attached to volume db7bdb03-7472-4dd3-85ee-680fb0fe5d44 Apr 13 17:52:27 user devstack@n-api.service[61677]: action_args: {'server_id': '832e4b85-2c48-469d-a21e-c56cccfcabe4', 'id': 'db7bdb03-7472-4dd3-85ee-680fb0fe5d44'} Apr 13 17:52:27 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id db7bdb03-7472-4dd3-85ee-680fb0fe5d44. Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 is not attached to volume db7bdb03-7472-4dd3-85ee-680fb0fe5d44 Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 is not attached to volume db7bdb03-7472-4dd3-85ee-680fb0fe5d44 Apr 13 17:52:27 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:52:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Returning 404 to user: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 is not attached to volume db7bdb03-7472-4dd3-85ee-680fb0fe5d44 {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:52:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8ce1d642-d477-4df0-9cee-861bcbae6205 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments/db7bdb03-7472-4dd3-85ee-680fb0fe5d44" status: 404 len: 154 microversion: 2.1 time: 0.118501 Apr 13 17:52:27 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 139/409] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:52:27 2023] DELETE /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4/os-volume_attachments/db7bdb03-7472-4dd3-85ee-680fb0fe5d44 => generated 154 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:30 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:52:30 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 204 len: 0 microversion: 2.1 time: 0.127613 Apr 13 17:52:30 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 135/410] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:52:30 2023] DELETE /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:52:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:30 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:30 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-caed288f-5574-4a07-b192-76791b335ead tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 200 len: 1543 microversion: 2.1 time: 0.174963 Apr 13 17:52:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 137/411] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:52:30 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 1543 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:52:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "name": "network-vif-unplugged", "status": "completed", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] Creating event network-vif-unplugged:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:52:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039884 Apr 13 17:52:30 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 140/412] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:31 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:31 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:31 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f4bb197f-4789-47ec-ae0c-040c977a3965 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b" status: 200 len: 1494 microversion: 2.1 time: 0.318581 Apr 13 17:52:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 136/413] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:52:31 2023] GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b => generated 1494 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:52:32 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "name": "network-vif-deleted", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] Creating event network-vif-deleted:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:52:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040835 Apr 13 17:52:32 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 138/414] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:32 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832e4b85-2c48-469d-a21e-c56cccfcabe4", "name": "network-vif-plugged", "status": "completed", "tag": "7c1fde03-37b1-418b-8a56-9d046c05a1e0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:32 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=21 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:32 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:32 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:32 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:32 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=35 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] Creating event network-vif-plugged:7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 on user Apr 13 17:52:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042713 Apr 13 17:52:32 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 141/415] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:33 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:33 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'services' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:52:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-volume_attachments/8ecd92a2-3a8e-4592-ab17-08f7c384c450" status: 202 len: 0 microversion: 2.1 time: 0.178015 Apr 13 17:52:33 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 137/416] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:52:33 2023] DELETE /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-volume_attachments/8ecd92a2-3a8e-4592-ab17-08f7c384c450 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:52:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a2cab57a-6870-4df4-81e0-eda49e915758 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:33 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a2cab57a-6870-4df4-81e0-eda49e915758 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2cab57a-6870-4df4-81e0-eda49e915758 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2cab57a-6870-4df4-81e0-eda49e915758 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2cab57a-6870-4df4-81e0-eda49e915758 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2cab57a-6870-4df4-81e0-eda49e915758 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2cab57a-6870-4df4-81e0-eda49e915758 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2cab57a-6870-4df4-81e0-eda49e915758 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:34 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a2cab57a-6870-4df4-81e0-eda49e915758 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048056 Apr 13 17:52:34 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:52:33 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-711902791", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "8d9da666-0149-44ad-8f19-8f10afceca63"}]}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] validate_networks() for [('8d9da666-0149-44ad-8f19-8f10afceca63', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:39 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting quotas for project d533287b8269447aab81fa7d1312d3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:52:39 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting quotas for user ec5fc9c7b7234904ba39d403764420b3 and project d533287b8269447aab81fa7d1312d3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:52:39 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:52:39 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:52:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.584979 Apr 13 17:52:39 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 142/418] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 17:52:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 17:52:39 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-1105b904-4e2d-42df-b5a2-f2e3a628f7e6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:39 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-1105b904-4e2d-42df-b5a2-f2e3a628f7e6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:39 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-1105b904-4e2d-42df-b5a2-f2e3a628f7e6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:39 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-1105b904-4e2d-42df-b5a2-f2e3a628f7e6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:39 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-1105b904-4e2d-42df-b5a2-f2e3a628f7e6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-1105b904-4e2d-42df-b5a2-f2e3a628f7e6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944" status: 200 len: 1394 microversion: 2.87 time: 0.084574 Apr 13 17:52:39 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 138/419] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:52:39 2023] GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 => generated 1394 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:52:41 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] Creating event network-changed:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:52:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030742 Apr 13 17:52:41 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 140/420] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:47 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:47 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:47 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'services' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:52:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments/5c44732c-d2f2-4383-895a-8ac2aeddeff9" status: 202 len: 0 microversion: 2.1 time: 0.183298 Apr 13 17:52:47 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 143/421] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:52:47 2023] DELETE /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments/5c44732c-d2f2-4383-895a-8ac2aeddeff9 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:52:47 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-22b08a52-0b15-46f2-b611-4f403e997a72 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:47 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-22b08a52-0b15-46f2-b611-4f403e997a72 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-22b08a52-0b15-46f2-b611-4f403e997a72 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-22b08a52-0b15-46f2-b611-4f403e997a72 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-22b08a52-0b15-46f2-b611-4f403e997a72 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-22b08a52-0b15-46f2-b611-4f403e997a72 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-22b08a52-0b15-46f2-b611-4f403e997a72 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-22b08a52-0b15-46f2-b611-4f403e997a72 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-22b08a52-0b15-46f2-b611-4f403e997a72 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054018 Apr 13 17:52:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 139/422] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:52:47 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:51 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:51 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:51 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:51 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-16f8b5ef-b17d-48fc-b2d1-af826ff169fb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f" status: 200 len: 1489 microversion: 2.1 time: 0.160840 Apr 13 17:52:51 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 141/423] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:52:51 2023] GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f => generated 1489 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:52:53 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:53 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:53 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-plugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] Creating event network-vif-plugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:52:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037368 Apr 13 17:52:53 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 144/424] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:55 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:52:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-plugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] Creating event network-vif-plugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:52:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030901 Apr 13 17:52:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 140/425] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:52:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:52:56 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:52:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:56 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Going to try to start instance {{(pid=61676) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 17:52:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/action" status: 202 len: 0 microversion: 2.1 time: 0.067318 Apr 13 17:52:56 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 142/426] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:52:56 2023] POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/action => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 17:52:56 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:56 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:56 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:52:56 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-881e04ce-6f52-4d27-819e-74e1406eb1ce tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1700 microversion: 2.1 time: 0.176070 Apr 13 17:52:56 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 145/427] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:52:56 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1700 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:52:57 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] HTTP exception thrown: Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 could not be found. Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Request method failure captured: Apr 13 17:52:57 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0 HTTP/1.1 Apr 13 17:52:57 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:52:57 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:52:57 user devstack@n-api.service[61678]: Connection: close Apr 13 17:52:57 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:52:57 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:52:57 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:52:57 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:52:57 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_R4HvjRM5-YiXzyZKenoBB9zyt31omHT6GrmS-uYAIWDgPDPRWaw1Jw4De45JJvSMlfHZYddSXQFi8B4rhnk2IQ3WLaoK1vJ2cTl0rWDf2LCQsyi0UDzBgVY1IOwTLRduLvwtqyBTLJx3s4MHkqL7higjaSS3cNAWfbdOgxSE41mA Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Project-Id: 2d6ea575d2574fcc99712adece6db415 Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Project-Name: tempest-VolumesAdminNegativeTest-1540143869 Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d6ea575d2574fcc99712adece6db415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d6ea575d2574fcc99712adece6db415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d6ea575d2574fcc99712adece6db415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Tenant: tempest-VolumesAdminNegativeTest-1540143869 Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Tenant-Id: 2d6ea575d2574fcc99712adece6db415 Apr 13 17:52:57 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1540143869 Apr 13 17:52:57 user devstack@n-api.service[61678]: X-User: tempest-VolumesAdminNegativeTest-1540143869-project-member Apr 13 17:52:57 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:52:57 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:52:57 user devstack@n-api.service[61678]: X-User-Id: 5d77fa5340ce44099224f2f161af5ecc Apr 13 17:52:57 user devstack@n-api.service[61678]: X-User-Name: tempest-VolumesAdminNegativeTest-1540143869-project-member Apr 13 17:52:57 user devstack@n-api.service[61678]: method: > Apr 13 17:52:57 user devstack@n-api.service[61678]: exception: Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 could not be found. Apr 13 17:52:57 user devstack@n-api.service[61678]: action_args: {'id': '85f8857e-9e9b-4a5a-912a-4d79014417d0'} Apr 13 17:52:57 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 could not be found. Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 could not be found. Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 could not be found. Apr 13 17:52:57 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:52:57 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Returning 404 to user: Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:52:57 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-24cda162-f831-480a-bff6-0a9c3ce9e96b tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0" status: 404 len: 111 microversion: 2.1 time: 0.034683 Apr 13 17:52:57 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 141/428] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:52:57 2023] GET /compute/v2.1/servers/85f8857e-9e9b-4a5a-912a-4d79014417d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:52:57 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-67497612-eaf4-4fa7-ab73-6666809a6bbe tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Calling method '.version_select at 0x7f82e25532e0>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:52:57 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-67497612-eaf4-4fa7-ab73-6666809a6bbe tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911294089" status: 202 len: 0 microversion: 2.1 time: 0.021760 Apr 13 17:52:57 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 143/429] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 17:52:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911294089 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:53:00 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-plugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:00 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:00 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] Creating event network-vif-plugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:53:00 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033517 Apr 13 17:53:00 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 146/430] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:02 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-plugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:02 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] Creating event network-vif-plugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:53:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 Apr 13 17:53:02 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 142/431] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:04 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:04 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-04b8722f-79b8-43d1-89a7-6bd571c1ddab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 200 len: 1653 microversion: 2.20 time: 0.169952 Apr 13 17:53:04 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 144/432] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:53:04 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 1653 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:18 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8e4096bfa5458b81aa51dc55394cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1775be5ea4c540b0a67bfe3468fd5901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:18 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-bf52b12b-b73a-457b-b2f0-91469b8b60c6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 200 len: 1431 microversion: 2.1 time: 0.153037 Apr 13 17:53:18 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 147/433] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:18 2023] GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 1431 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=12 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] Creating event network-changed:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:53:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041349 Apr 13 17:53:20 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 143/434] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=5 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:20 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] HTTP exception thrown: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 could not be found. Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Request method failure captured: Apr 13 17:53:20 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 HTTP/1.1 Apr 13 17:53:20 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:53:20 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:53:20 user devstack@n-api.service[61676]: Connection: close Apr 13 17:53:20 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:53:20 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:53:20 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:53:20 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:53:20 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEAm-0TEb7fc9lKCwp4mctd_3n1ealIlOB4ivtqhBhcctijvaZAwLfT1X09Em1gdkDoX0-rzVa6aHsKeY_olXX2T6_c2W7PSLrVIvwxW4TXP1Y8hs0nGGQjrz0M7F8ibyBUJM1TELui1AX1BUNETGX2iVDbZqt0tU5TaIcZgNh74cVA Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Project-Id: 88bc3754064947c89397db4a80161b3a Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Project-Name: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88bc3754064947c89397db4a80161b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88bc3754064947c89397db4a80161b3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88bc3754064947c89397db4a80161b3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Tenant: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Tenant-Id: 88bc3754064947c89397db4a80161b3a Apr 13 17:53:20 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:53:20 user devstack@n-api.service[61676]: X-User: tempest-TestMinimumBasicScenario-1587858147-project-member Apr 13 17:53:20 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:53:20 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:53:20 user devstack@n-api.service[61676]: X-User-Id: 8bdac67b9cc149b4b802c96fc87fc801 Apr 13 17:53:20 user devstack@n-api.service[61676]: X-User-Name: tempest-TestMinimumBasicScenario-1587858147-project-member Apr 13 17:53:20 user devstack@n-api.service[61676]: method: > Apr 13 17:53:20 user devstack@n-api.service[61676]: exception: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 could not be found. Apr 13 17:53:20 user devstack@n-api.service[61676]: action_args: {'id': '832e4b85-2c48-469d-a21e-c56cccfcabe4'} Apr 13 17:53:20 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 could not be found. Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 could not be found. Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 could not be found. Apr 13 17:53:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Returning 404 to user: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:53:20 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-92baf0b2-9fa2-492e-aa11-eae60f9c6309 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4" status: 404 len: 111 microversion: 2.1 time: 0.036556 Apr 13 17:53:20 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:20 2023] GET /compute/v2.1/servers/832e4b85-2c48-469d-a21e-c56cccfcabe4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:53:20 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9b870d5e-2e33-425e-81b4-dcbf358b9ea6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '.version_select at 0x7f82e241ef80>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:20 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lazy-loading 'flavor' on Instance uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:53:20 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9b870d5e-2e33-425e-81b4-dcbf358b9ea6 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1346102396" status: 202 len: 0 microversion: 2.1 time: 0.192953 Apr 13 17:53:20 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 148/436] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 13 17:53:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1346102396 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:53:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.116743 Apr 13 17:53:20 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 144/437] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:53:20 2023] POST /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:20 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8e4096bfa5458b81aa51dc55394cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1775be5ea4c540b0a67bfe3468fd5901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:20 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a7fee9c2-22f0-4e11-a875-aced87d69839 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 200 len: 1437 microversion: 2.1 time: 0.176220 Apr 13 17:53:20 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 146/438] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:20 2023] GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 1437 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:53:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ae37e53b-44d8-4909-ab36-4a111746c6cd tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Action: 'create', calling method: .version_select at 0x7f82e232a710>, body: {"keypair": {"name": "tempest-keypair-524527809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnXDVHfTRBpUYlfAprk3mH31AF7eAqIbu95MlzLdOPYk1JsNbgVz6Q8uk8avvttZwx/1EKAYyctcuQvsAVcd0JmpEuj9BDolmd+t4kHEuS8yvx4inVgSe5ePvBOsuhIZg=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:22 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-ae37e53b-44d8-4909-ab36-4a111746c6cd tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Getting quotas for project b120144ed4294837a716e156b12222e3. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:53:22 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-ae37e53b-44d8-4909-ab36-4a111746c6cd tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Getting quotas for user c859ceec3df54c6ab1ae98a2c5320c2a and project b120144ed4294837a716e156b12222e3. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:53:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-ae37e53b-44d8-4909-ab36-4a111746c6cd tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.046699 Apr 13 17:53:22 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 149/439] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 17:53:22 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 17:53:22 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "name": "network-vif-unplugged", "status": "completed", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}, {"server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "name": "network-vif-plugged", "status": "completed", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Creating event network-vif-unplugged:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:53:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Creating event network-vif-plugged:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:53:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029860 Apr 13 17:53:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 145/440] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:22 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ca0555db-ad90-48bd-a9f5-42d497a98711 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'create', calling method: .version_select at 0x7f82e2864310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-969682718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLysvbE0Zrt+5zeKxWLtNIm39mAiKNd+gGRtek5jM3u3q5+HDdY7ZVNT4gqmc4z9u+Zv3inGiNzJbMJwWIVELJjhr617KXuuTECL0R2iXXA0bPv4LE/O7ioJZYA/bq18fA=="}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:23 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-ca0555db-ad90-48bd-a9f5-42d497a98711 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting quotas for project 88bc3754064947c89397db4a80161b3a. Resources: {'key_pairs'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:53:23 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-ca0555db-ad90-48bd-a9f5-42d497a98711 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting quotas for user 8bdac67b9cc149b4b802c96fc87fc801 and project 88bc3754064947c89397db4a80161b3a. Resources: {'key_pairs'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:53:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ca0555db-ad90-48bd-a9f5-42d497a98711 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044359 Apr 13 17:53:23 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 147/441] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:53:23 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1896778579", "imageRef": "28d6a612-1fe1-4e25-bad1-473206295a5a", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-969682718", "networks": [{"uuid": "53908975-b8a1-42b2-a261-83a8ab29f858"}]}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] validate_networks() for [('53908975-b8a1-42b2-a261-83a8ab29f858', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:53:23 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-928673615", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "465a1bd9-320e-482e-823c-9caf66903d60"}], "security_groups": [{"name": "tempest-securitygroup--1032022594"}], "key_name": "tempest-keypair-524527809", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:23 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] validate_networks() for [('465a1bd9-320e-482e-823c-9caf66903d60', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:24 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting quotas for project 88bc3754064947c89397db4a80161b3a. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:53:24 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting quotas for user 8bdac67b9cc149b4b802c96fc87fc801 and project 88bc3754064947c89397db4a80161b3a. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:53:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:53:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='28d6a612-1fe1-4e25-bad1-473206295a5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-81c3dd6f-9bad-4fdc-98eb-dcb7b344af1d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-81c3dd6f-9bad-4fdc-98eb-dcb7b344af1d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-81c3dd6f-9bad-4fdc-98eb-dcb7b344af1d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-81c3dd6f-9bad-4fdc-98eb-dcb7b344af1d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-81c3dd6f-9bad-4fdc-98eb-dcb7b344af1d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-81c3dd6f-9bad-4fdc-98eb-dcb7b344af1d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-81c3dd6f-9bad-4fdc-98eb-dcb7b344af1d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-81c3dd6f-9bad-4fdc-98eb-dcb7b344af1d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-81c3dd6f-9bad-4fdc-98eb-dcb7b344af1d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075490 Apr 13 17:53:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 148/442] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:53:24 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:53:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.634348 Apr 13 17:53:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 150/443] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:53:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-fc5a7229-5a8e-422c-bf17-079c769e4c5f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-fc5a7229-5a8e-422c-bf17-079c769e4c5f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-fc5a7229-5a8e-422c-bf17-079c769e4c5f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-fc5a7229-5a8e-422c-bf17-079c769e4c5f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 200 len: 1252 microversion: 2.1 time: 0.101068 Apr 13 17:53:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 149/444] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:24 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 1252 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Getting quotas for project b120144ed4294837a716e156b12222e3. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Getting quotas for user c859ceec3df54c6ab1ae98a2c5320c2a and project b120144ed4294837a716e156b12222e3. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:53:24 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:53:24 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.729282 Apr 13 17:53:24 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 146/445] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 17:53:23 2023] POST /compute/v2.1/servers => generated 404 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 17:53:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9fe5e318-7e0b-4110-8f27-3bed8081925c tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9fe5e318-7e0b-4110-8f27-3bed8081925c tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] Creating event network-changed:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:53:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037733 Apr 13 17:53:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 150/446] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:24 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-9fe5e318-7e0b-4110-8f27-3bed8081925c tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:24 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-9fe5e318-7e0b-4110-8f27-3bed8081925c tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:24 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-9fe5e318-7e0b-4110-8f27-3bed8081925c tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9fe5e318-7e0b-4110-8f27-3bed8081925c tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d" status: 200 len: 1319 microversion: 2.49 time: 0.087415 Apr 13 17:53:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 151/447] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:53:24 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d => generated 1319 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:53:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-32c0efa2-e42f-4579-8777-6e50a795a928 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '.version_select at 0x7f82e2570af0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-32c0efa2-e42f-4579-8777-6e50a795a928 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/ad21ab82-d8b1-45fb-a91a-338177c31b59" status: 204 len: 0 microversion: 2.1 time: 0.243469 Apr 13 17:53:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 147/448] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:26 2023] DELETE /compute/v2.1/images/ad21ab82-d8b1-45fb-a91a-338177c31b59 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:53:26 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:26 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:26 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:53:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef" status: 204 len: 0 microversion: 2.1 time: 0.136428 Apr 13 17:53:26 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 151/449] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:53:26 2023] DELETE /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 17:53:26 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:26 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:27 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbea54954e534fdc933b94936a47a0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a0fd6f48449a7ba8f9944243580b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-000c021c-fcf7-4535-997a-09b4b59a7849 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef" status: 200 len: 1678 microversion: 2.1 time: 0.219181 Apr 13 17:53:27 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:26 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:53:27 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-unplugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:27 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] Creating event network-vif-unplugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:53:27 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049791 Apr 13 17:53:27 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 148/451] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] Creating event network-changed:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:53:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032081 Apr 13 17:53:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 152/452] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-plugged", "status": "completed", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}, {"server_uuid": "69605608-790d-49be-ab18-277549242bef", "name": "network-vif-deleted", "tag": "29f94d48-0d45-4fe8-b310-e02fb491f42f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:29 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:29 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-98855959-44f9-4de6-a5c6-c4961d9e3bb5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944" status: 200 len: 1768 microversion: 2.87 time: 0.188640 Apr 13 17:53:29 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 153/453] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:53:29 2023] GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 => generated 1768 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:53:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] Creating event network-vif-plugged:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:53:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] Creating event network-vif-deleted:29f94d48-0d45-4fe8-b310-e02fb491f42f for instance 69605608-790d-49be-ab18-277549242bef on user Apr 13 17:53:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030117 Apr 13 17:53:29 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 149/454] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "tag": "274ea36d-e1f3-418a-9afa-173db904ef77"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:29 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] Creating event network-changed:274ea36d-e1f3-418a-9afa-173db904ef77 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:53:29 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027241 Apr 13 17:53:29 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 153/455] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-plugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] Creating event network-vif-plugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:53:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056935 Apr 13 17:53:30 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 154/456] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:32 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-plugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] Creating event network-vif-plugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:53:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043474 Apr 13 17:53:32 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 150/457] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:32 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-plugged", "status": "completed", "tag": "274ea36d-e1f3-418a-9afa-173db904ef77"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] Creating event network-vif-plugged:274ea36d-e1f3-418a-9afa-173db904ef77 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:53:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032252 Apr 13 17:53:32 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 154/458] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2854306a-7640-477d-af56-eee1432a50fa tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1159894703", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "destination_type": "local"}, {"source_type": "volume", "uuid": "6fcb1d88-318d-4243-b327-2f187bdab0c4", "destination_type": "invalid"}], "networks": [{"uuid": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8"}]}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2854306a-7640-477d-af56-eee1432a50fa tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Request method failure captured: Apr 13 17:53:33 user devstack@n-api.service[61677]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 17:53:33 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:53:33 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:53:33 user devstack@n-api.service[61677]: Connection: close Apr 13 17:53:33 user devstack@n-api.service[61677]: Content-Length: 494 Apr 13 17:53:33 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:53:33 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:53:33 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:53:33 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_RqbR01I-yaCp36KYOr-JDnHTiQpZVu80RD6rKwOqdSLxXFwjJ9OXC1r4y_CHnkg-q9E5AXdlVyThhG0yWYUdw9GAisEqk7eTWNIfdzvGJzWaKPc7M54q-RQVHH0rjTBorNtFw25dYyJ8_5pUVEDDw-91IG-HbMMD1V89Eyq_BXk8 Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Project-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Project-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Tenant: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Tenant-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:53:33 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:53:33 user devstack@n-api.service[61677]: X-User: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:53:33 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:53:33 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:53:33 user devstack@n-api.service[61677]: X-User-Id: b33d4309055340a4b42df540ca62d59f Apr 13 17:53:33 user devstack@n-api.service[61677]: X-User-Name: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:53:33 user devstack@n-api.service[61677]: Apr 13 17:53:33 user devstack@n-api.service[61677]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1159894703", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "destination_type": "local"}, {"source_type": "volume", "uuid": "6fcb1d88-318d-4243-b327-2f187bdab0c4", "destination_type": "invalid"}], "networks": [{"uuid": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8"}]}} Apr 13 17:53:33 user devstack@n-api.service[61677]: method: > Apr 13 17:53:33 user devstack@n-api.service[61677]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 17:53:33 user devstack@n-api.service[61677]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1159894703', 'imageRef': 'c7f9966b-afb1-42f9-9999-e623e0bf219a', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c7f9966b-afb1-42f9-9999-e623e0bf219a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '6fcb1d88-318d-4243-b327-2f187bdab0c4', 'destination_type': 'invalid'}], 'networks': [{'uuid': '74134ba8-d8bf-4dbd-853e-3b5e62fad8e8'}]}}} Apr 13 17:53:33 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise error Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi 'invalid' Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 17:53:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:53:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2854306a-7640-477d-af56-eee1432a50fa tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:53:33 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2854306a-7640-477d-af56-eee1432a50fa tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.014254 Apr 13 17:53:33 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 155/459] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:53:33 2023] POST /compute/v2.1/servers => generated 155 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:53:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:33 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:33 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-351a5618-ddc0-471c-86de-4e8a33548f44 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b" status: 200 len: 1494 microversion: 2.1 time: 0.156648 Apr 13 17:53:33 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 151/460] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:33 2023] GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b => generated 1494 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:53:34 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:34 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-plugged", "status": "completed", "tag": "274ea36d-e1f3-418a-9afa-173db904ef77"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:53:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:34 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] Creating event network-vif-plugged:274ea36d-e1f3-418a-9afa-173db904ef77 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:53:34 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051392 Apr 13 17:53:34 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 155/461] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:53:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=12 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-15a45ee3-57ff-4122-b25e-ceef7d63af7b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-15a45ee3-57ff-4122-b25e-ceef7d63af7b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15a45ee3-57ff-4122-b25e-ceef7d63af7b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15a45ee3-57ff-4122-b25e-ceef7d63af7b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15a45ee3-57ff-4122-b25e-ceef7d63af7b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15a45ee3-57ff-4122-b25e-ceef7d63af7b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15a45ee3-57ff-4122-b25e-ceef7d63af7b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-15a45ee3-57ff-4122-b25e-ceef7d63af7b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-15a45ee3-57ff-4122-b25e-ceef7d63af7b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053295 Apr 13 17:53:37 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 156/462] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:53:37 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:37 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-790fbf06-ed35-41db-acf6-02d01ee0df75 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1677 microversion: 2.1 time: 0.164485 Apr 13 17:53:37 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 152/463] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:37 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:53:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:37 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:38 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-fc878941-5f8e-4ebb-88a9-19c82853449f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1677 microversion: 2.1 time: 0.160985 Apr 13 17:53:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 156/464] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:37 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:53:38 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:38 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:38 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:38 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-91d695e5-2ba0-412f-91ba-eb6b82e24a56 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1677 microversion: 2.1 time: 0.160524 Apr 13 17:53:38 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 157/465] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:38 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:53:46 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:46 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:46 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-dd17ea01-5aa6-41e1-a871-91eed7c59847 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1704 microversion: 2.1 time: 0.144330 Apr 13 17:53:46 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 153/466] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:46 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1704 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:53:51 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:53:51 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-162f28cb-f994-4af2-9236-788e794791a6 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88" status: 200 len: 1503 microversion: 2.1 time: 0.156596 Apr 13 17:53:51 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 157/467] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:53:51 2023] GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=34 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9c1f6c14-6d5f-4e8f-9b51-92e3ea31e0f1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "841bd7fe-de3a-41ad-b1c2-1e46cf6645e8"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9c1f6c14-6d5f-4e8f-9b51-92e3ea31e0f1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c1f6c14-6d5f-4e8f-9b51-92e3ea31e0f1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c1f6c14-6d5f-4e8f-9b51-92e3ea31e0f1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c1f6c14-6d5f-4e8f-9b51-92e3ea31e0f1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c1f6c14-6d5f-4e8f-9b51-92e3ea31e0f1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c1f6c14-6d5f-4e8f-9b51-92e3ea31e0f1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9c1f6c14-6d5f-4e8f-9b51-92e3ea31e0f1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9c1f6c14-6d5f-4e8f-9b51-92e3ea31e0f1 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.340247 Apr 13 17:54:05 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 158/468] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 17:54:04 2023] POST /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments => generated 188 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:05 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61678) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 17:54:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/action" status: 202 len: 0 microversion: 2.20 time: 0.152005 Apr 13 17:54:05 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 154/469] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 17:54:05 2023] POST /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:05 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-30b83728-0b02-4398-957a-d7dc08297912 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 200 len: 1739 microversion: 2.20 time: 0.154452 Apr 13 17:54:05 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 158/470] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:54:05 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:54:11 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:11 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:11 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8e4096bfa5458b81aa51dc55394cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1775be5ea4c540b0a67bfe3468fd5901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-77d57403-f555-48e6-8745-b9ea71e79366 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 200 len: 1495 microversion: 2.1 time: 0.159669 Apr 13 17:54:11 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 159/471] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:54:11 2023] GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 1495 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:54:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] Creating event network-changed:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:54:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030299 Apr 13 17:54:12 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 155/472] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:14 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:14 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-3acbd632-6493-4d88-9f48-aaef7580eb1f tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 200 len: 1537 microversion: 2.1 time: 0.149339 Apr 13 17:54:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 159/473] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:54:14 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:14 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:14 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-0b2a9e86-7349-43b9-860c-6fb7049930cc tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d" status: 200 len: 1627 microversion: 2.49 time: 0.149741 Apr 13 17:54:14 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 160/474] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:54:14 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d => generated 1627 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:17 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] HTTP exception thrown: Instance 69605608-790d-49be-ab18-277549242bef could not be found. Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Request method failure captured: Apr 13 17:54:17 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef HTTP/1.1 Apr 13 17:54:17 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:54:17 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:54:17 user devstack@n-api.service[61678]: Connection: close Apr 13 17:54:17 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:54:17 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:54:17 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:54:17 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:54:17 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_ZlPRXKIhsTqRIp8wrcNt8ngGYb0dKo2GBuEVvxO-v2CWlzWq0CKpcsLeueyt2N_5Z4CUEAjyYtvSgNlu7vIVPejJRI86FEf3LWjBVcxrw_MuEIW4PFMDvTC5WCD8U33ktADgqinmkbiXFYzzkFvMm_5lER5wl6uW01e5mVhyAo1Q Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Project-Id: 984a0fd6f48449a7ba8f9944243580b9 Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1535501044 Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/984a0fd6f48449a7ba8f9944243580b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/984a0fd6f48449a7ba8f9944243580b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/984a0fd6f48449a7ba8f9944243580b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Tenant: tempest-ServerStableDeviceRescueTest-1535501044 Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Tenant-Id: 984a0fd6f48449a7ba8f9944243580b9 Apr 13 17:54:17 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1535501044 Apr 13 17:54:17 user devstack@n-api.service[61678]: X-User: tempest-ServerStableDeviceRescueTest-1535501044-project-member Apr 13 17:54:17 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:54:17 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:54:17 user devstack@n-api.service[61678]: X-User-Id: cbea54954e534fdc933b94936a47a0b3 Apr 13 17:54:17 user devstack@n-api.service[61678]: X-User-Name: tempest-ServerStableDeviceRescueTest-1535501044-project-member Apr 13 17:54:17 user devstack@n-api.service[61678]: method: > Apr 13 17:54:17 user devstack@n-api.service[61678]: exception: Instance 69605608-790d-49be-ab18-277549242bef could not be found. Apr 13 17:54:17 user devstack@n-api.service[61678]: action_args: {'id': '69605608-790d-49be-ab18-277549242bef'} Apr 13 17:54:17 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69605608-790d-49be-ab18-277549242bef could not be found. Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69605608-790d-49be-ab18-277549242bef could not be found. Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69605608-790d-49be-ab18-277549242bef could not be found. Apr 13 17:54:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:54:17 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Returning 404 to user: Instance 69605608-790d-49be-ab18-277549242bef could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:54:17 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0d940b65-f529-431b-a70d-f75c3bee9f77 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef" status: 404 len: 111 microversion: 2.1 time: 0.027845 Apr 13 17:54:17 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 156/475] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:54:17 2023] GET /compute/v2.1/servers/69605608-790d-49be-ab18-277549242bef => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:54:17 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-4e2685bf-0072-4188-8f67-edb9ce0ce753 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Calling method '.version_select at 0x7f82e2522440>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:17 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-4e2685bf-0072-4188-8f67-edb9ce0ce753 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772761791" status: 202 len: 0 microversion: 2.1 time: 0.027632 Apr 13 17:54:17 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 160/476] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 17:54:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772761791 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:54:20 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "name": "network-vif-plugged", "status": "completed", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:20 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] Creating event network-vif-plugged:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:54:20 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 Apr 13 17:54:20 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 161/477] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:22 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "name": "network-vif-plugged", "status": "completed", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] Creating event network-vif-plugged:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:54:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031044 Apr 13 17:54:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 157/478] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=12 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "269337d0-9772-4c29-8a73-2f74b0697546"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:29 user devstack@n-api.service[61676]: DEBUG nova.objects.instance [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'flavor' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=61676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:54:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944/action" status: 200 len: 29 microversion: 2.87 time: 0.452657 Apr 13 17:54:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 161/479] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 17:54:29 2023] POST /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944/action => generated 29 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=8 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:30 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-216063aa-0972-4158-b24a-bd3033bd5214 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944" status: 200 len: 1774 microversion: 2.87 time: 0.278239 Apr 13 17:54:30 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 162/480] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:54:30 2023] GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 => generated 1774 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 17:54:31 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-unplugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] Creating event network-vif-unplugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:54:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032228 Apr 13 17:54:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 158/481] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-plugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] Creating event network-vif-plugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:54:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031733 Apr 13 17:54:33 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 162/482] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:35 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-plugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] Creating event network-vif-plugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:54:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043406 Apr 13 17:54:35 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 163/483] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-plugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:54:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] Creating event network-vif-plugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:54:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123996 Apr 13 17:54:37 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 159/484] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] HTTP exception thrown: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Request method failure captured: Apr 13 17:54:37 user devstack@n-api.service[61676]: request: DELETE /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 HTTP/1.1 Apr 13 17:54:37 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:54:37 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:54:37 user devstack@n-api.service[61676]: Connection: close Apr 13 17:54:37 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:54:37 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:54:37 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:54:37 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:54:37 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_RqbR01I-yaCp36KYOr-JDnHTiQpZVu80RD6rKwOqdSLxXFwjJ9OXC1r4y_CHnkg-q9E5AXdlVyThhG0yWYUdw9GAisEqk7eTWNIfdzvGJzWaKPc7M54q-RQVHH0rjTBorNtFw25dYyJ8_5pUVEDDw-91IG-HbMMD1V89Eyq_BXk8 Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Project-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Project-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Tenant: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Tenant-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:54:37 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:54:37 user devstack@n-api.service[61676]: X-User: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:54:37 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:54:37 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:54:37 user devstack@n-api.service[61676]: X-User-Id: b33d4309055340a4b42df540ca62d59f Apr 13 17:54:37 user devstack@n-api.service[61676]: X-User-Name: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:54:37 user devstack@n-api.service[61676]: method: > Apr 13 17:54:37 user devstack@n-api.service[61676]: exception: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61676]: action_args: {'id': '0243764f-846b-4675-9ea1-49d07b05cdb5'} Apr 13 17:54:37 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Returning 404 to user: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:54:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-e87982ed-27dd-4b97-bbdb-2abce20a051f tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5" status: 404 len: 111 microversion: 2.1 time: 0.057169 Apr 13 17:54:37 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 163/485] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:54:37 2023] DELETE /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] HTTP exception thrown: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Request method failure captured: Apr 13 17:54:37 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 HTTP/1.1 Apr 13 17:54:37 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:54:37 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:54:37 user devstack@n-api.service[61677]: Connection: close Apr 13 17:54:37 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:54:37 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:54:37 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:54:37 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:54:37 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_RqbR01I-yaCp36KYOr-JDnHTiQpZVu80RD6rKwOqdSLxXFwjJ9OXC1r4y_CHnkg-q9E5AXdlVyThhG0yWYUdw9GAisEqk7eTWNIfdzvGJzWaKPc7M54q-RQVHH0rjTBorNtFw25dYyJ8_5pUVEDDw-91IG-HbMMD1V89Eyq_BXk8 Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Project-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Project-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Tenant: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Tenant-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:54:37 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:54:37 user devstack@n-api.service[61677]: X-User: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:54:37 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:54:37 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:54:37 user devstack@n-api.service[61677]: X-User-Id: b33d4309055340a4b42df540ca62d59f Apr 13 17:54:37 user devstack@n-api.service[61677]: X-User-Name: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:54:37 user devstack@n-api.service[61677]: method: > Apr 13 17:54:37 user devstack@n-api.service[61677]: exception: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61677]: action_args: {'id': '0243764f-846b-4675-9ea1-49d07b05cdb5'} Apr 13 17:54:37 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. Apr 13 17:54:37 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:54:37 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Returning 404 to user: Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:54:37 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-0832bd6b-cc0e-473c-833b-b92543e40456 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5" status: 404 len: 111 microversion: 2.1 time: 0.038140 Apr 13 17:54:37 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 164/486] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:54:37 2023] GET /compute/v2.1/servers/0243764f-846b-4675-9ea1-49d07b05cdb5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:38 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:54:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b" status: 204 len: 0 microversion: 2.1 time: 0.142602 Apr 13 17:54:38 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 160/487] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:54:37 2023] DELETE /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:54:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:38 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:38 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ae738479-eec5-4342-a437-cf1a03bdc7a1 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b" status: 200 len: 1500 microversion: 2.1 time: 0.254084 Apr 13 17:54:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 164/488] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:54:38 2023] GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b => generated 1500 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:54:39 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc89ac54-6844-45b9-8dac-c10d893b699b", "name": "network-vif-deleted", "tag": "6431e14a-e7e3-4cb5-9fe6-015c1debef03"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] Creating event network-vif-deleted:6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance bc89ac54-6844-45b9-8dac-c10d893b699b on user Apr 13 17:54:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032432 Apr 13 17:54:39 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 165/489] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:39 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc89ac54-6844-45b9-8dac-c10d893b699b", "name": "network-vif-unplugged", "status": "completed", "tag": "6431e14a-e7e3-4cb5-9fe6-015c1debef03"}, {"server_uuid": "bc89ac54-6844-45b9-8dac-c10d893b699b", "name": "network-vif-plugged", "status": "completed", "tag": "6431e14a-e7e3-4cb5-9fe6-015c1debef03"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Creating event network-vif-unplugged:6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance bc89ac54-6844-45b9-8dac-c10d893b699b on user Apr 13 17:54:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Creating event network-vif-plugged:6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance bc89ac54-6844-45b9-8dac-c10d893b699b on user Apr 13 17:54:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033906 Apr 13 17:54:39 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 161/490] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:39 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:39 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:40 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-00f9b79c-b146-45fb-8923-71c46bfd5350 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1677 microversion: 2.1 time: 0.177798 Apr 13 17:54:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 165/491] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:54:39 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:54:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc848d65-78d3-466f-9c07-311725e1d7ba"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316528 Apr 13 17:54:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 166/492] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:54:40 2023] POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:46 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:46 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:47 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'services' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:54:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/os-volume_attachments/101df4ac-9f5e-4960-85e3-ccb7dc4be985" status: 202 len: 0 microversion: 2.1 time: 0.353538 Apr 13 17:54:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 162/493] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:54:46 2023] DELETE /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/os-volume_attachments/101df4ac-9f5e-4960-85e3-ccb7dc4be985 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:54:47 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:47 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Old instance type m1.nano, new instance type m1.micro {{(pid=61676) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for user 8f796555c0e242d091502725ec595c0f and project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:54:48 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:54:48 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/action" status: 202 len: 0 microversion: 2.1 time: 0.308573 Apr 13 17:54:48 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 166/494] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:54:47 2023] POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:54:48 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:48 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:48 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:48 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-0e949a1d-c654-4149-b42c-4f88a994dbbf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1732 microversion: 2.1 time: 0.160294 Apr 13 17:54:48 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 167/495] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:54:48 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:54:49 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:49 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Going to try to stop instance {{(pid=61678) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 17:54:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/action" status: 202 len: 0 microversion: 2.1 time: 0.105847 Apr 13 17:54:49 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 163/496] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:54:49 2023] POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:54:49 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:49 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:49 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:49 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-4da7db60-9be3-4997-b7b4-707931f5b006 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1668 microversion: 2.1 time: 0.187091 Apr 13 17:54:49 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 167/497] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:54:49 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1668 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:54:49 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-unplugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] Creating event network-vif-unplugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:54:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029695 Apr 13 17:54:49 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 168/498] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:51 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-unplugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:51 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] Creating event network-vif-unplugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:54:51 user devstack@n-api.service[61678]: DEBUG nova.compute.api [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61678) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 17:54:51 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054371 Apr 13 17:54:51 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 164/499] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:51 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-plugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:51 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] Creating event network-vif-plugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:54:51 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033221 Apr 13 17:54:51 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 168/500] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:53 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:54:53 user devstack@n-api.service[61677]: DEBUG nova.compute.api [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61677) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 17:54:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074381 Apr 13 17:54:53 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 169/501] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:54 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:54 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'flavor' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:54:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88/action" status: 200 len: 32 microversion: 2.1 time: 0.105011 Apr 13 17:54:54 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 165/502] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:54:54 2023] POST /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88/action => generated 32 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:54:54 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:54 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:54 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:54 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-90540960-98e8-4e00-99c8-eb203e3873cb tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88" status: 200 len: 1509 microversion: 2.1 time: 0.216891 Apr 13 17:54:54 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 169/503] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:54:54 2023] GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:54:55 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-unplugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] Creating event network-vif-unplugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:54:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028960 Apr 13 17:54:55 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 170/504] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:55 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:54:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-d41a2731-6d1b-485a-97f8-e3a8f86690d8 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 200 len: 1784 microversion: 2.20 time: 0.224370 Apr 13 17:54:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 166/505] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:54:55 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 1784 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:54:57 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-plugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:57 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] Creating event network-vif-plugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:54:57 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033121 Apr 13 17:54:57 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 170/506] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:54:59 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-plugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}, {"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-plugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:54:59 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:54:59 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:54:59 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:54:59 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Creating event network-vif-plugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:54:59 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Creating event network-vif-plugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:54:59 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029350 Apr 13 17:54:59 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 171/507] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:54:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:04 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:55:04 user devstack@n-api.service[61678]: DEBUG nova.compute.api [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61678) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 17:55:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045125 Apr 13 17:55:04 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 167/508] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:06 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:06 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:06 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=33 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:06 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:06 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:55:06 user devstack@n-api.service[61676]: DEBUG nova.compute.api [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61676) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 17:55:06 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057881 Apr 13 17:55:06 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 171/509] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=22 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:11 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61677) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 17:55:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.143457 Apr 13 17:55:11 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 172/510] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:55:11 2023] POST /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:11 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8e4096bfa5458b81aa51dc55394cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1775be5ea4c540b0a67bfe3468fd5901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-03dd3875-e626-4884-97c2-636f4bb2b6f6 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 200 len: 1503 microversion: 2.1 time: 0.184039 Apr 13 17:55:11 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 168/511] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:11 2023] GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-afde12fe-7aa4-48a6-9c22-9175082a7cfe tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 200 len: 1537 microversion: 2.1 time: 0.204313 Apr 13 17:55:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 172/512] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:14 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 1537 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Searching by: {'deleted': False, 'project_id': '88bc3754064947c89397db4a80161b3a'} {{(pid=61677) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:14 user devstack@n-api.service[61677]: DEBUG nova.compute.multi_cell_list [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61677) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 17:55:14 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1bf12c80-01e2-43d2-ae05-77fe2e059942 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.077504 Apr 13 17:55:14 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 173/513] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 17:55:14 2023] GET /compute/v2.1/servers => generated 341 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:14 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:14 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-4ad5a58a-b672-4c1a-8022-92ed0d94c4d2 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-4ad5a58a-b672-4c1a-8022-92ed0d94c4d2 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4ad5a58a-b672-4c1a-8022-92ed0d94c4d2 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4ad5a58a-b672-4c1a-8022-92ed0d94c4d2 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4ad5a58a-b672-4c1a-8022-92ed0d94c4d2 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4ad5a58a-b672-4c1a-8022-92ed0d94c4d2 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4ad5a58a-b672-4c1a-8022-92ed0d94c4d2 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4ad5a58a-b672-4c1a-8022-92ed0d94c4d2 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-4ad5a58a-b672-4c1a-8022-92ed0d94c4d2 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.123046 Apr 13 17:55:15 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 173/514] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 17:55:14 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-interface => generated 283 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:55:15 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-17e8603b-8ba4-46de-91d5-92a47bc0b0c8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 200 len: 1537 microversion: 2.1 time: 0.193215 Apr 13 17:55:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 169/515] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:14 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 1537 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "tag": "274ea36d-e1f3-418a-9afa-173db904ef77"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] Creating event network-changed:274ea36d-e1f3-418a-9afa-173db904ef77 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:55:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051691 Apr 13 17:55:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 174/516] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:16 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:16 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2b8b07f8-17f3-44ae-aa98-f59cccb488a6 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d" status: 200 len: 1627 microversion: 2.49 time: 0.195524 Apr 13 17:55:16 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 174/517] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:55:16 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d => generated 1627 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:55:16 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "tag": "nic-tag"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:16 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c60a8519-20b4-4b4e-8b21-368ebb46656e"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:17 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311178 Apr 13 17:55:17 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 175/518] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:55:16 2023] POST /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:18 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "tag": "552a278f-c1f9-4704-b9d1-67b2d41328f0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] Creating event network-changed:552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:55:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040894 Apr 13 17:55:18 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 175/519] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:20 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-interface" status: 200 len: 280 microversion: 2.49 time: 4.419758 Apr 13 17:55:20 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 170/520] 10.0.0.210 () {66 vars in 1414 bytes} [Thu Apr 13 17:55:16 2023] POST /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-interface => generated 280 bytes in 4422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:55:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "157b095b-a1e5-4109-848a-7cc1061e0a61", "tag": "volume-tag"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:20 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:20 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:20 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:20 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-plugged", "status": "completed", "tag": "552a278f-c1f9-4704-b9d1-67b2d41328f0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] Creating event network-vif-plugged:552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:55:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034577 Apr 13 17:55:21 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 171/521] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:21 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.311896 Apr 13 17:55:21 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 176/522] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 17:55:20 2023] POST /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:55:21 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:21 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:21 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1e53c3c4-5144-45dc-937d-b251adca7327 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944" status: 200 len: 1754 microversion: 2.87 time: 0.544093 Apr 13 17:55:21 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 176/523] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:55:20 2023] GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 => generated 1754 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:55:22 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-d26a438e-f040-4a3e-91a4-735498c498dc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Action: 'create', calling method: .version_select at 0x7f82e2570820>, body: {"keypair": {"name": "tempest-TestStampPattern-712492187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOee4kPdtfOLNy1ytdjd7yBnUKAwywli75vBkY27mNMRuhoq73L4ZPE7uc6dJ0/80Gsy1bQvIFT+Crg/RZP1memr4IUvUalto0GRwTvb8iu/YKK1o7MK60JLbPjFpTYlsA=="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:22 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-d26a438e-f040-4a3e-91a4-735498c498dc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting quotas for project 433b58054cc942efad3646ebf4ff286e. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:55:22 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-d26a438e-f040-4a3e-91a4-735498c498dc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting quotas for user 2b565bc35a4742808d360a395858134b and project 433b58054cc942efad3646ebf4ff286e. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:55:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-d26a438e-f040-4a3e-91a4-735498c498dc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.146891 Apr 13 17:55:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 172/524] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:55:21 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}, {"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-plugged", "status": "completed", "tag": "552a278f-c1f9-4704-b9d1-67b2d41328f0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Creating event network-changed:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:55:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Creating event network-vif-plugged:552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:55:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039308 Apr 13 17:55:23 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 177/525] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:23 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "name": "network-vif-plugged", "status": "completed", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:25 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] Creating event network-vif-plugged:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:55:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049864 Apr 13 17:55:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 177/526] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:27 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "name": "network-vif-plugged", "status": "completed", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:27 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] Creating event network-vif-plugged:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:55:27 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051640 Apr 13 17:55:27 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 173/527] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-415392179", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "key_name": "tempest-TestStampPattern-712492187", "security_groups": [{"name": "tempest-secgroup-smoke-436240886"}], "networks": [{"uuid": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7"}]}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] validate_networks() for [('a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting quotas for project 433b58054cc942efad3646ebf4ff286e. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting quotas for user 2b565bc35a4742808d360a395858134b and project 433b58054cc942efad3646ebf4ff286e. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:55:27 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:55:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.591861 Apr 13 17:55:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 178/528] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:55:27 2023] POST /compute/v2.1/servers => generated 403 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:55:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-cf242807-3b72-4082-b869-1a96eda01153 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:27 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-cf242807-3b72-4082-b869-1a96eda01153 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:27 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-cf242807-3b72-4082-b869-1a96eda01153 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-cf242807-3b72-4082-b869-1a96eda01153 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030" status: 200 len: 1235 microversion: 2.1 time: 0.075714 Apr 13 17:55:27 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 178/529] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:27 2023] GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030 => generated 1235 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] HTTP exception thrown: Instance bc89ac54-6844-45b9-8dac-c10d893b699b could not be found. Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Request method failure captured: Apr 13 17:55:28 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b HTTP/1.1 Apr 13 17:55:28 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:55:28 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:55:28 user devstack@n-api.service[61678]: Connection: close Apr 13 17:55:28 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:55:28 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:55:28 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:55:28 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:55:28 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_RqbR01I-yaCp36KYOr-JDnHTiQpZVu80RD6rKwOqdSLxXFwjJ9OXC1r4y_CHnkg-q9E5AXdlVyThhG0yWYUdw9GAisEqk7eTWNIfdzvGJzWaKPc7M54q-RQVHH0rjTBorNtFw25dYyJ8_5pUVEDDw-91IG-HbMMD1V89Eyq_BXk8 Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Project-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Project-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4fbca3daa10432c8abf5e8cc0dff050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Tenant: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Tenant-Id: b4fbca3daa10432c8abf5e8cc0dff050 Apr 13 17:55:28 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-ServersNegativeTestJSON-238465742 Apr 13 17:55:28 user devstack@n-api.service[61678]: X-User: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:55:28 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:55:28 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:55:28 user devstack@n-api.service[61678]: X-User-Id: b33d4309055340a4b42df540ca62d59f Apr 13 17:55:28 user devstack@n-api.service[61678]: X-User-Name: tempest-ServersNegativeTestJSON-238465742-project-member Apr 13 17:55:28 user devstack@n-api.service[61678]: method: > Apr 13 17:55:28 user devstack@n-api.service[61678]: exception: Instance bc89ac54-6844-45b9-8dac-c10d893b699b could not be found. Apr 13 17:55:28 user devstack@n-api.service[61678]: action_args: {'id': 'bc89ac54-6844-45b9-8dac-c10d893b699b'} Apr 13 17:55:28 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc89ac54-6844-45b9-8dac-c10d893b699b could not be found. Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc89ac54-6844-45b9-8dac-c10d893b699b could not be found. Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc89ac54-6844-45b9-8dac-c10d893b699b could not be found. Apr 13 17:55:28 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:55:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Returning 404 to user: Instance bc89ac54-6844-45b9-8dac-c10d893b699b could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:55:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f5f202a9-acce-4fe7-8a36-56f4f9fb1df5 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b" status: 404 len: 111 microversion: 2.1 time: 0.030529 Apr 13 17:55:28 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 174/530] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:28 2023] GET /compute/v2.1/servers/bc89ac54-6844-45b9-8dac-c10d893b699b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:55:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:29 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:29 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:29 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1d38c495-8377-4ead-b11a-22dd0df5a1ca tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 200 len: 1583 microversion: 2.1 time: 0.162151 Apr 13 17:55:29 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 179/531] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:29 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 1583 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:31 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:31 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] Creating event network-changed:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:55:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049334 Apr 13 17:55:31 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 179/532] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:31 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'services' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:55:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-volume_attachments/157b095b-a1e5-4109-848a-7cc1061e0a61" status: 202 len: 0 microversion: 2.49 time: 0.275211 Apr 13 17:55:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 175/533] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 17:55:31 2023] DELETE /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-volume_attachments/157b095b-a1e5-4109-848a-7cc1061e0a61 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 13 17:55:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9851b648-0b93-441b-9912-2216b528d030", "tag": "b13328b5-41f1-4f0d-a862-d2e286c0602f"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] Creating event network-changed:b13328b5-41f1-4f0d-a862-d2e286c0602f for instance 9851b648-0b93-441b-9912-2216b528d030 on user Apr 13 17:55:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052416 Apr 13 17:55:33 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 180/534] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1786022957"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:33 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:34 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-interface/552a278f-c1f9-4704-b9d1-67b2d41328f0" status: 202 len: 0 microversion: 2.49 time: 0.055454 Apr 13 17:55:34 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 176/535] 10.0.0.210 () {64 vars in 1507 bytes} [Thu Apr 13 17:55:34 2023] DELETE /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-interface/552a278f-c1f9-4704-b9d1-67b2d41328f0 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:55:34 user devstack@n-api.service[61677]: INFO nova.network.security_group_api [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Adding security group 58db5b06-a49b-4a33-aaa8-bb2ef3dc25f0 to port c42e9982-60be-4b92-8ea1-460ff84f6a26 Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2952f00f-669b-4d14-b891-c619473c9887 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-2952f00f-669b-4d14-b891-c619473c9887 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2952f00f-669b-4d14-b891-c619473c9887 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2952f00f-669b-4d14-b891-c619473c9887 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2952f00f-669b-4d14-b891-c619473c9887 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2952f00f-669b-4d14-b891-c619473c9887 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2952f00f-669b-4d14-b891-c619473c9887 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2952f00f-669b-4d14-b891-c619473c9887 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:34 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2952f00f-669b-4d14-b891-c619473c9887 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-instance-actions/req-01c307e0-792c-4cd9-8f97-3a7a91607ce3" status: 200 len: 474 microversion: 2.49 time: 0.219645 Apr 13 17:55:34 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 181/536] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 17:55:34 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-instance-actions/req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 => generated 474 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:55:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-dcc4a2a2-f9bb-484b-b860-d15d13a2ecfd tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/action" status: 202 len: 0 microversion: 2.1 time: 1.032752 Apr 13 17:55:34 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 180/537] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:55:33 2023] POST /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/action => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:34 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] Creating event network-changed:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:55:34 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036290 Apr 13 17:55:34 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 182/538] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9b237af1-293c-4f91-8f05-0fc722aabb3c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 200 len: 1749 microversion: 2.1 time: 0.449457 Apr 13 17:55:35 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 177/539] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:34 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 1749 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:35 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:35 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-unplugged", "status": "completed", "tag": "552a278f-c1f9-4704-b9d1-67b2d41328f0"}, {"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-plugged", "status": "completed", "tag": "552a278f-c1f9-4704-b9d1-67b2d41328f0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/action" status: 202 len: 0 microversion: 2.1 time: 0.096748 Apr 13 17:55:35 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 181/540] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:55:35 2023] POST /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:55:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Creating event network-vif-unplugged:552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:55:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Creating event network-vif-plugged:552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036004 Apr 13 17:55:35 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 183/541] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:35 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:35 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-99d9ecd4-c35e-4f4e-b035-32c0d275a104 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 200 len: 1741 microversion: 2.1 time: 0.332286 Apr 13 17:55:35 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 178/542] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:35 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 1741 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:36 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9851b648-0b93-441b-9912-2216b528d030", "name": "network-vif-plugged", "status": "completed", "tag": "b13328b5-41f1-4f0d-a862-d2e286c0602f"}, {"server_uuid": "9851b648-0b93-441b-9912-2216b528d030", "name": "network-vif-plugged", "status": "completed", "tag": "b13328b5-41f1-4f0d-a862-d2e286c0602f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:36 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Creating event network-vif-plugged:b13328b5-41f1-4f0d-a862-d2e286c0602f for instance 9851b648-0b93-441b-9912-2216b528d030 on user Apr 13 17:55:36 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Creating event network-vif-plugged:b13328b5-41f1-4f0d-a862-d2e286c0602f for instance 9851b648-0b93-441b-9912-2216b528d030 on user Apr 13 17:55:36 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040867 Apr 13 17:55:36 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 182/543] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-039c2728-d7ba-48e8-a66d-6d582e7ed6ae req-797b6849-ba12-41b9-b3d9-b48e68d514fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-deleted", "tag": "552a278f-c1f9-4704-b9d1-67b2d41328f0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:37 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-039c2728-d7ba-48e8-a66d-6d582e7ed6ae req-797b6849-ba12-41b9-b3d9-b48e68d514fc service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-039c2728-d7ba-48e8-a66d-6d582e7ed6ae req-797b6849-ba12-41b9-b3d9-b48e68d514fc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-039c2728-d7ba-48e8-a66d-6d582e7ed6ae req-797b6849-ba12-41b9-b3d9-b48e68d514fc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:37 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-039c2728-d7ba-48e8-a66d-6d582e7ed6ae req-797b6849-ba12-41b9-b3d9-b48e68d514fc service nova] Creating event network-vif-deleted:552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:55:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-039c2728-d7ba-48e8-a66d-6d582e7ed6ae req-797b6849-ba12-41b9-b3d9-b48e68d514fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033277 Apr 13 17:55:37 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 184/544] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:38 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:38 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-08981cb1-ce31-4340-a2b1-77c5a1c78368 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1731 microversion: 2.1 time: 0.178594 Apr 13 17:55:38 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 179/545] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:38 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:39 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:39 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:39 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-unplugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] Creating event network-vif-unplugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:55:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045769 Apr 13 17:55:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 185/546] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:55:40 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-870f25a2-8469-49dd-9c85-520f2fdfc102 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1645 microversion: 2.1 time: 0.329793 Apr 13 17:55:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 183/547] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:39 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1645 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-plugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}, {"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-plugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Creating event network-vif-plugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:55:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Creating event network-vif-plugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:55:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062215 Apr 13 17:55:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 180/548] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:44 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-plugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:55:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:44 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] Creating event network-vif-plugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:55:44 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028633 Apr 13 17:55:44 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 186/549] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:55:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:44 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:55:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a1c7a21b-de4c-4975-a590-484cd6d9c1db tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88" status: 200 len: 1489 microversion: 2.1 time: 0.404062 Apr 13 17:55:44 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 184/550] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:55:44 2023] GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 => generated 1489 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:55:55 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:56 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:56 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7bd1ad70-c419-4aa2-97d4-a08d8c1a63ab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:56 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7bd1ad70-c419-4aa2-97d4-a08d8c1a63ab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7bd1ad70-c419-4aa2-97d4-a08d8c1a63ab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7bd1ad70-c419-4aa2-97d4-a08d8c1a63ab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7bd1ad70-c419-4aa2-97d4-a08d8c1a63ab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7bd1ad70-c419-4aa2-97d4-a08d8c1a63ab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7bd1ad70-c419-4aa2-97d4-a08d8c1a63ab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7bd1ad70-c419-4aa2-97d4-a08d8c1a63ab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:56 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7bd1ad70-c419-4aa2-97d4-a08d8c1a63ab tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments/841bd7fe-de3a-41ad-b1c2-1e46cf6645e8" status: 200 len: 194 microversion: 2.20 time: 0.300815 Apr 13 17:55:56 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 181/551] 10.0.0.210 () {64 vars in 1531 bytes} [Thu Apr 13 17:55:55 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments/841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=5 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=5 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:56 user devstack@n-api.service[61676]: DEBUG nova.objects.instance [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'services' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=61676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:55:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments/841bd7fe-de3a-41ad-b1c2-1e46cf6645e8" status: 202 len: 0 microversion: 2.20 time: 0.356599 Apr 13 17:55:56 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 187/552] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 17:55:56 2023] DELETE /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments/841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-c0e03033-4faa-4a6e-8c3d-33845f644cb2 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-c0e03033-4faa-4a6e-8c3d-33845f644cb2 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=5 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c0e03033-4faa-4a6e-8c3d-33845f644cb2 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c0e03033-4faa-4a6e-8c3d-33845f644cb2 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c0e03033-4faa-4a6e-8c3d-33845f644cb2 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c0e03033-4faa-4a6e-8c3d-33845f644cb2 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c0e03033-4faa-4a6e-8c3d-33845f644cb2 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:55:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c0e03033-4faa-4a6e-8c3d-33845f644cb2 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:55:56 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-c0e03033-4faa-4a6e-8c3d-33845f644cb2 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062539 Apr 13 17:55:56 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 185/553] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 17:55:56 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:56:01 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:01 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:01 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8e4096bfa5458b81aa51dc55394cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1775be5ea4c540b0a67bfe3468fd5901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:01 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-2a13809f-5cf5-4912-b58e-7c8ed83c85ab tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 200 len: 1548 microversion: 2.1 time: 0.195143 Apr 13 17:56:01 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 182/554] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:56:01 2023] GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:18 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c8ee3a5c-2810-4641-90f4-b1bce1176788 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030" status: 200 len: 1537 microversion: 2.1 time: 0.166880 Apr 13 17:56:18 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 188/555] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:56:18 2023] GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030 => generated 1537 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944/action" status: 202 len: 0 microversion: 2.87 time: 0.091001 Apr 13 17:56:21 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 186/556] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 17:56:21 2023] POST /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=12 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:21 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-43ab316a-d2d1-45b7-92cd-3206e4097932 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944" status: 200 len: 1762 microversion: 2.87 time: 0.207523 Apr 13 17:56:21 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 183/557] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:56:21 2023] GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 => generated 1762 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:56:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-unplugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] Creating event network-vif-unplugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:56:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036773 Apr 13 17:56:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 189/558] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-plugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}, {"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-plugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Creating event network-vif-plugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:56:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Creating event network-vif-plugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:56:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045781 Apr 13 17:56:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 187/559] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-cc373661-2301-48b3-96fb-ea88ff9480f7 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-cc373661-2301-48b3-96fb-ea88ff9480f7 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-cc373661-2301-48b3-96fb-ea88ff9480f7 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-cc373661-2301-48b3-96fb-ea88ff9480f7 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-cc373661-2301-48b3-96fb-ea88ff9480f7 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-cc373661-2301-48b3-96fb-ea88ff9480f7 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-cc373661-2301-48b3-96fb-ea88ff9480f7 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-cc373661-2301-48b3-96fb-ea88ff9480f7 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-cc373661-2301-48b3-96fb-ea88ff9480f7 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-instance-actions/req-01c307e0-792c-4cd9-8f97-3a7a91607ce3" status: 200 len: 503 microversion: 2.49 time: 0.087967 Apr 13 17:56:24 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 184/560] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 17:56:24 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-instance-actions/req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 => generated 503 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-45642c6d-cfbb-443a-aa95-1e3ccad8ca86 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-45642c6d-cfbb-443a-aa95-1e3ccad8ca86 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45642c6d-cfbb-443a-aa95-1e3ccad8ca86 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45642c6d-cfbb-443a-aa95-1e3ccad8ca86 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45642c6d-cfbb-443a-aa95-1e3ccad8ca86 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45642c6d-cfbb-443a-aa95-1e3ccad8ca86 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45642c6d-cfbb-443a-aa95-1e3ccad8ca86 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-45642c6d-cfbb-443a-aa95-1e3ccad8ca86 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-45642c6d-cfbb-443a-aa95-1e3ccad8ca86 tempest-TaggedAttachmentsTest-1365186060 tempest-TaggedAttachmentsTest-1365186060-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-instance-actions/req-01c307e0-792c-4cd9-8f97-3a7a91607ce3" status: 200 len: 503 microversion: 2.49 time: 0.049282 Apr 13 17:56:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 190/561] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 17:56:24 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-instance-actions/req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 => generated 503 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a6b2c7f1-f8dd-41a7-bbdb-ae262d56591a tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a6b2c7f1-f8dd-41a7-bbdb-ae262d56591a tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a6b2c7f1-f8dd-41a7-bbdb-ae262d56591a tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a6b2c7f1-f8dd-41a7-bbdb-ae262d56591a tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a6b2c7f1-f8dd-41a7-bbdb-ae262d56591a tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a6b2c7f1-f8dd-41a7-bbdb-ae262d56591a tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a6b2c7f1-f8dd-41a7-bbdb-ae262d56591a tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a6b2c7f1-f8dd-41a7-bbdb-ae262d56591a tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a6b2c7f1-f8dd-41a7-bbdb-ae262d56591a tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.051940 Apr 13 17:56:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 188/562] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 17:56:24 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:56:24 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d" status: 204 len: 0 microversion: 2.49 time: 0.130531 Apr 13 17:56:24 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 185/563] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 17:56:24 2023] DELETE /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:25 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:25 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:25 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:25 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-de290818-3f35-4c36-9510-d34896b2e80f tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d" status: 200 len: 1751 microversion: 2.49 time: 0.184147 Apr 13 17:56:25 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 191/564] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:56:24 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:56:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-unplugged", "status": "completed", "tag": "274ea36d-e1f3-418a-9afa-173db904ef77"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] Creating event network-vif-unplugged:274ea36d-e1f3-418a-9afa-173db904ef77 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:56:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153084 Apr 13 17:56:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 189/565] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:25 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:26 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-aa6dd9f1-d9a2-484b-ad3a-d90bbb76e818 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 200 len: 1749 microversion: 2.1 time: 0.166966 Apr 13 17:56:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 186/566] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:56:25 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:56:26 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-plugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] Creating event network-vif-plugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 17:56:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040982 Apr 13 17:56:26 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 192/567] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-plugged", "status": "completed", "tag": "274ea36d-e1f3-418a-9afa-173db904ef77"}, {"server_uuid": "d0042ccb-5c99-4880-8ec4-3a3c54769d6d", "name": "network-vif-deleted", "tag": "274ea36d-e1f3-418a-9afa-173db904ef77"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] Creating event network-vif-plugged:274ea36d-e1f3-418a-9afa-173db904ef77 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:56:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] Creating event network-vif-deleted:274ea36d-e1f3-418a-9afa-173db904ef77 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d on user Apr 13 17:56:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033139 Apr 13 17:56:27 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 190/568] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/action" status: 202 len: 0 microversion: 2.1 time: 0.202965 Apr 13 17:56:38 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 187/569] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:56:38 2023] POST /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:56:38 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=10 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:38 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=24 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:38 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:39 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:39 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-9a2eb594-b1eb-4017-a137-6df5d6c4a6a3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1730 microversion: 2.1 time: 0.219355 Apr 13 17:56:39 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 193/570] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:56:38 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:56:40 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:40 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:56:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-unplugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Going to try to start instance {{(pid=61677) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 17:56:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] Creating event network-vif-unplugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:56:40 user devstack@n-api.service[61678]: DEBUG nova.compute.api [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61678) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 17:56:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035147 Apr 13 17:56:40 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 188/571] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/action" status: 202 len: 0 microversion: 2.1 time: 0.128237 Apr 13 17:56:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 191/572] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:56:40 2023] POST /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:56:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:40 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:40 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-73f1df5b-9c67-4786-8d35-1b75aa86e40b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1654 microversion: 2.1 time: 0.173040 Apr 13 17:56:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 194/573] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:56:40 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1654 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:56:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:56:42 user devstack@n-api.service[61678]: DEBUG nova.compute.api [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61678) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 17:56:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040417 Apr 13 17:56:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 189/574] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:56:43 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-plugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:43 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] Creating event network-vif-plugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:56:43 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041527 Apr 13 17:56:43 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 192/575] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a554c72-3e83-40e3-8c4f-506b2e90230e"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:44 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 474af9f8-6700-4288-8133-a8dad4cf8a88 while it is in vm_state rescued Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Request method failure captured: Apr 13 17:56:44 user devstack@n-api.service[61676]: request: POST /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88/os-volume_attachments HTTP/1.1 Apr 13 17:56:44 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:56:44 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:56:44 user devstack@n-api.service[61676]: Connection: close Apr 13 17:56:44 user devstack@n-api.service[61676]: Content-Length: 74 Apr 13 17:56:44 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:56:44 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:56:44 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:56:44 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEDQnq4eQIZsnZOBn_j0_FU-f6LzfH5sy33GgC-hZqDIpXlV9V16O3ymT_4_jNnW8zh3Wer2j7e-5Vd1U0kX2BDIXPghI3-OHKVTmGKeSIMWv8bHIM3PWyuZyexyDKi3Zc4I686nabAZRhg5TYwZuKE4MHrKq5Bakp5f8QPHOtRfXWo Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Project-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Tenant: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Tenant-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 17:56:44 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 17:56:44 user devstack@n-api.service[61676]: X-User: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 17:56:44 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:56:44 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:56:44 user devstack@n-api.service[61676]: X-User-Id: 8f1fe2e6fd894d5c87d7ccf5fae553ca Apr 13 17:56:44 user devstack@n-api.service[61676]: X-User-Name: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 17:56:44 user devstack@n-api.service[61676]: Apr 13 17:56:44 user devstack@n-api.service[61676]: {"volumeAttachment": {"volumeId": "2a554c72-3e83-40e3-8c4f-506b2e90230e"}} Apr 13 17:56:44 user devstack@n-api.service[61676]: method: > Apr 13 17:56:44 user devstack@n-api.service[61676]: exception: Cannot 'attach_volume' instance 474af9f8-6700-4288-8133-a8dad4cf8a88 while it is in vm_state rescued Apr 13 17:56:44 user devstack@n-api.service[61676]: action_args: {'server_id': '474af9f8-6700-4288-8133-a8dad4cf8a88', 'body': {'volumeAttachment': {'volumeId': '2a554c72-3e83-40e3-8c4f-506b2e90230e'}}} Apr 13 17:56:44 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 474af9f8-6700-4288-8133-a8dad4cf8a88 while it is in vm_state rescued Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 474af9f8-6700-4288-8133-a8dad4cf8a88 while it is in vm_state rescued Apr 13 17:56:44 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:56:44 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Returning 409 to user: Cannot 'attach_volume' instance 474af9f8-6700-4288-8133-a8dad4cf8a88 while it is in vm_state rescued {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:56:44 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-638d80da-1ec8-4a01-97d8-d53bae426108 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041515 Apr 13 17:56:44 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 195/576] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:56:44 2023] POST /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 17:56:44 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:44 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88/action" status: 202 len: 0 microversion: 2.1 time: 0.075477 Apr 13 17:56:45 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 190/577] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:56:44 2023] POST /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:56:45 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:45 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:45 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:45 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-0e972a34-475c-4edb-9c34-8c18fa9e067d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88" status: 200 len: 1497 microversion: 2.1 time: 0.189458 Apr 13 17:56:45 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 193/578] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:56:45 2023] GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:56:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-plugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] Creating event network-vif-plugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:56:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031746 Apr 13 17:56:45 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 196/579] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:46 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-681f27ba-8893-452a-a704-391a8c16354e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:46 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-681f27ba-8893-452a-a704-391a8c16354e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-681f27ba-8893-452a-a704-391a8c16354e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-681f27ba-8893-452a-a704-391a8c16354e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-681f27ba-8893-452a-a704-391a8c16354e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-681f27ba-8893-452a-a704-391a8c16354e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-681f27ba-8893-452a-a704-391a8c16354e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-681f27ba-8893-452a-a704-391a8c16354e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-681f27ba-8893-452a-a704-391a8c16354e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044426 Apr 13 17:56:46 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 191/580] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 17:56:46 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:56:46 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:46 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:46 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:46 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:56:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 204 len: 0 microversion: 2.20 time: 0.159867 Apr 13 17:56:47 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 194/581] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 17:56:46 2023] DELETE /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-unplugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}, {"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-plugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Creating event network-vif-unplugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:56:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Creating event network-vif-plugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:56:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033674 Apr 13 17:56:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 192/582] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:47 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:47 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:56:47 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a2b63103-4499-411d-8e81-5d572981e410 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 200 len: 1712 microversion: 2.20 time: 0.432669 Apr 13 17:56:47 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 197/583] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:56:47 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 1712 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:56:47 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "name": "network-vif-unplugged", "status": "completed", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] Creating event network-vif-unplugged:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:56:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.241550 Apr 13 17:56:47 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 195/584] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:49 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "name": "network-vif-deleted", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] Creating event network-vif-deleted:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:56:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035933 Apr 13 17:56:49 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 193/585] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:49 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-plugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}, {"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-plugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:49 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Creating event network-vif-plugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:56:49 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Creating event network-vif-plugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 17:56:49 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031457 Apr 13 17:56:49 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 198/586] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:49 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1753314b-bfd7-4e8b-986b-0253666ab8aa", "name": "network-vif-plugged", "status": "completed", "tag": "72193ca5-011d-4cf8-b016-194d83952281"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] Creating event network-vif-plugged:72193ca5-011d-4cf8-b016-194d83952281 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa on user Apr 13 17:56:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061535 Apr 13 17:56:49 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 196/587] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:56:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:56:54 user devstack@n-api.service[61678]: DEBUG nova.compute.api [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61678) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 17:56:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058187 Apr 13 17:56:54 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 194/588] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:56:56 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:56:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:56:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:56:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:56:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:56:56 user devstack@n-api.service[61676]: DEBUG nova.compute.api [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61676) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 17:56:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042265 Apr 13 17:56:56 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 199/589] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:56:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] Creating event network-changed:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:57:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033542 Apr 13 17:57:03 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:57:03 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 195/590] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:57:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 204 len: 0 microversion: 2.1 time: 0.121076 Apr 13 17:57:03 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 197/591] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:57:03 2023] DELETE /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:57:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:03 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:03 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8e4096bfa5458b81aa51dc55394cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1775be5ea4c540b0a67bfe3468fd5901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-85896f21-b17a-400d-b375-29736f933636 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 200 len: 1554 microversion: 2.1 time: 0.200877 Apr 13 17:57:03 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 200/592] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:57:03 2023] GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:57:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "name": "network-vif-unplugged", "status": "completed", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] Creating event network-vif-unplugged:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:57:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042928 Apr 13 17:57:03 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 196/593] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:57:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:05 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "name": "network-vif-plugged", "status": "completed", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}, {"server_uuid": "dc1716d8-163a-4a50-8b3a-dbde50340fb8", "name": "network-vif-deleted", "tag": "8064fded-37fe-474e-bf38-2f6c094dd0d0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] Creating event network-vif-plugged:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:57:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] Creating event network-vif-deleted:8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 on user Apr 13 17:57:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037791 Apr 13 17:57:05 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 198/594] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:57:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=17 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=37 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:11 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-7293045a-08aa-4d3c-be09-b010fd7cd70c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944" status: 200 len: 1768 microversion: 2.87 time: 0.158277 Apr 13 17:57:11 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 201/595] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:57:11 2023] GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 => generated 1768 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] HTTP exception thrown: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Request method failure captured: Apr 13 17:57:15 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d HTTP/1.1 Apr 13 17:57:15 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:57:15 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:57:15 user devstack@n-api.service[61678]: Connection: close Apr 13 17:57:15 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:57:15 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:57:15 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:57:15 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:57:15 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEGISACtfGHF55WWqF7gtYUQTqPukoDrqfWzW8s24TmngcYy3BRuZYGRCU4RzUzviVSBchZawMXpmbLiPf3VAL3tf1FqvhyGmIpOEgBHWYg2yj3ZaPPDVBI-BZHl85xuljrBFEXnEV5Z9-ZPwdMvtJQ4NcRNKHwLaZLINPi8dDn3Ko8 Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Project-Id: b120144ed4294837a716e156b12222e3 Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Project-Name: tempest-TaggedAttachmentsTest-1546533741 Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b120144ed4294837a716e156b12222e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b120144ed4294837a716e156b12222e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b120144ed4294837a716e156b12222e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Tenant: tempest-TaggedAttachmentsTest-1546533741 Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Tenant-Id: b120144ed4294837a716e156b12222e3 Apr 13 17:57:15 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1546533741 Apr 13 17:57:15 user devstack@n-api.service[61678]: X-User: tempest-TaggedAttachmentsTest-1546533741-project-member Apr 13 17:57:15 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:57:15 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:57:15 user devstack@n-api.service[61678]: X-User-Id: c859ceec3df54c6ab1ae98a2c5320c2a Apr 13 17:57:15 user devstack@n-api.service[61678]: X-User-Name: tempest-TaggedAttachmentsTest-1546533741-project-member Apr 13 17:57:15 user devstack@n-api.service[61678]: method: > Apr 13 17:57:15 user devstack@n-api.service[61678]: exception: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:15 user devstack@n-api.service[61678]: action_args: {'id': 'd0042ccb-5c99-4880-8ec4-3a3c54769d6d'} Apr 13 17:57:15 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Returning 404 to user: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:57:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-83737b22-8493-414b-9bdb-3de4c6611da8 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d" status: 404 len: 111 microversion: 2.49 time: 0.038347 Apr 13 17:57:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 197/596] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:57:15 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:57:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f1d123ee-79d6-4ec3-a6ba-d2f2cccfaa93 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '.version_select at 0x7f82e23c8d30>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:15 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f1d123ee-79d6-4ec3-a6ba-d2f2cccfaa93 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-524527809" status: 204 len: 0 microversion: 2.49 time: 0.036651 Apr 13 17:57:15 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 199/597] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 17:57:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-524527809 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:17 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] HTTP exception thrown: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Request method failure captured: Apr 13 17:57:17 user devstack@n-api.service[61676]: request: DELETE /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d HTTP/1.1 Apr 13 17:57:17 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:57:17 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:57:17 user devstack@n-api.service[61676]: Connection: close Apr 13 17:57:17 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:57:17 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:57:17 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:57:17 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:57:17 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEGISACtfGHF55WWqF7gtYUQTqPukoDrqfWzW8s24TmngcYy3BRuZYGRCU4RzUzviVSBchZawMXpmbLiPf3VAL3tf1FqvhyGmIpOEgBHWYg2yj3ZaPPDVBI-BZHl85xuljrBFEXnEV5Z9-ZPwdMvtJQ4NcRNKHwLaZLINPi8dDn3Ko8 Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Project-Id: b120144ed4294837a716e156b12222e3 Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Project-Name: tempest-TaggedAttachmentsTest-1546533741 Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b120144ed4294837a716e156b12222e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b120144ed4294837a716e156b12222e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b120144ed4294837a716e156b12222e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Tenant: tempest-TaggedAttachmentsTest-1546533741 Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Tenant-Id: b120144ed4294837a716e156b12222e3 Apr 13 17:57:17 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1546533741 Apr 13 17:57:17 user devstack@n-api.service[61676]: X-User: tempest-TaggedAttachmentsTest-1546533741-project-member Apr 13 17:57:17 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:57:17 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:57:17 user devstack@n-api.service[61676]: X-User-Id: c859ceec3df54c6ab1ae98a2c5320c2a Apr 13 17:57:17 user devstack@n-api.service[61676]: X-User-Name: tempest-TaggedAttachmentsTest-1546533741-project-member Apr 13 17:57:17 user devstack@n-api.service[61676]: method: > Apr 13 17:57:17 user devstack@n-api.service[61676]: exception: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61676]: action_args: {'id': 'd0042ccb-5c99-4880-8ec4-3a3c54769d6d'} Apr 13 17:57:17 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Returning 404 to user: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:57:17 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-6be50bd4-d663-4b9e-8601-743ec372d791 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d" status: 404 len: 111 microversion: 2.49 time: 0.028946 Apr 13 17:57:17 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 202/598] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 17:57:17 2023] DELETE /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:17 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] HTTP exception thrown: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Request method failure captured: Apr 13 17:57:17 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d HTTP/1.1 Apr 13 17:57:17 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:57:17 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:57:17 user devstack@n-api.service[61678]: Connection: close Apr 13 17:57:17 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:57:17 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:57:17 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:57:17 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:57:17 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEGISACtfGHF55WWqF7gtYUQTqPukoDrqfWzW8s24TmngcYy3BRuZYGRCU4RzUzviVSBchZawMXpmbLiPf3VAL3tf1FqvhyGmIpOEgBHWYg2yj3ZaPPDVBI-BZHl85xuljrBFEXnEV5Z9-ZPwdMvtJQ4NcRNKHwLaZLINPi8dDn3Ko8 Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Project-Id: b120144ed4294837a716e156b12222e3 Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Project-Name: tempest-TaggedAttachmentsTest-1546533741 Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b120144ed4294837a716e156b12222e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b120144ed4294837a716e156b12222e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b120144ed4294837a716e156b12222e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Tenant: tempest-TaggedAttachmentsTest-1546533741 Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Tenant-Id: b120144ed4294837a716e156b12222e3 Apr 13 17:57:17 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1546533741 Apr 13 17:57:17 user devstack@n-api.service[61678]: X-User: tempest-TaggedAttachmentsTest-1546533741-project-member Apr 13 17:57:17 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:57:17 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:57:17 user devstack@n-api.service[61678]: X-User-Id: c859ceec3df54c6ab1ae98a2c5320c2a Apr 13 17:57:17 user devstack@n-api.service[61678]: X-User-Name: tempest-TaggedAttachmentsTest-1546533741-project-member Apr 13 17:57:17 user devstack@n-api.service[61678]: method: > Apr 13 17:57:17 user devstack@n-api.service[61678]: exception: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61678]: action_args: {'id': 'd0042ccb-5c99-4880-8ec4-3a3c54769d6d'} Apr 13 17:57:17 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. Apr 13 17:57:17 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:57:17 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Returning 404 to user: Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:57:17 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-bfdc1a60-a785-4425-8d0c-9b7827390038 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d" status: 404 len: 111 microversion: 2.49 time: 0.034508 Apr 13 17:57:17 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 198/599] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:57:17 2023] GET /compute/v2.1/servers/d0042ccb-5c99-4880-8ec4-3a3c54769d6d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:18 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:18 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-48e7d0f6-3ced-4f54-bf23-211a16a8f978 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030" status: 200 len: 1537 microversion: 2.1 time: 0.162145 Apr 13 17:57:18 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 200/600] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:57:18 2023] GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030 => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:57:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9851b648-0b93-441b-9912-2216b528d030", "tag": "b13328b5-41f1-4f0d-a862-d2e286c0602f"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:20 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] Creating event network-changed:b13328b5-41f1-4f0d-a862-d2e286c0602f for instance 9851b648-0b93-441b-9912-2216b528d030 on user Apr 13 17:57:20 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034165 Apr 13 17:57:20 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 203/601] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:20 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e5aab40-4eb4-44b3-a738-4f230bae10b3"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:20 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296905 Apr 13 17:57:20 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 199/602] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:57:20 2023] POST /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:26 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1786022957"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:26 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:26 user devstack@n-api.service[61677]: INFO nova.network.security_group_api [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Removing security group 58db5b06-a49b-4a33-aaa8-bb2ef3dc25f0 from port c42e9982-60be-4b92-8ea1-460ff84f6a26 Apr 13 17:57:26 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-dba081b7-fffe-4ce3-98fc-332a6265d7b5 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/action" status: 202 len: 0 microversion: 2.1 time: 0.614552 Apr 13 17:57:26 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 201/603] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:57:26 2023] POST /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:57:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] Creating event network-changed:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:57:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236847 Apr 13 17:57:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 204/604] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:57:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:28 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:28 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'services' on Instance uuid 37a22063-cedb-45b0-8554-b1e60a7d4324 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:57:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments/c60a8519-20b4-4b4e-8b21-368ebb46656e" status: 202 len: 0 microversion: 2.1 time: 0.408726 Apr 13 17:57:28 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 200/605] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:57:28 2023] DELETE /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments/c60a8519-20b4-4b4e-8b21-368ebb46656e => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:57:28 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-67d05f64-4012-4e1d-8e4f-bca802c2bab8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:28 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-67d05f64-4012-4e1d-8e4f-bca802c2bab8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-67d05f64-4012-4e1d-8e4f-bca802c2bab8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-67d05f64-4012-4e1d-8e4f-bca802c2bab8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-67d05f64-4012-4e1d-8e4f-bca802c2bab8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-67d05f64-4012-4e1d-8e4f-bca802c2bab8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-67d05f64-4012-4e1d-8e4f-bca802c2bab8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-67d05f64-4012-4e1d-8e4f-bca802c2bab8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:28 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-67d05f64-4012-4e1d-8e4f-bca802c2bab8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048512 Apr 13 17:57:28 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 202/606] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:57:28 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:29 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] Creating event network-changed:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:57:29 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029109 Apr 13 17:57:29 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 205/607] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:57:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:57:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:29 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:29 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:29 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'services' on Instance uuid 9851b648-0b93-441b-9912-2216b528d030 {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:57:29 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:29 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-53c1e2bc-f553-4b90-ac01-f2ae9ee952bf tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1723 microversion: 2.1 time: 0.185433 Apr 13 17:57:29 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 201/608] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:57:29 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:57:29 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments/2e5aab40-4eb4-44b3-a738-4f230bae10b3" status: 202 len: 0 microversion: 2.1 time: 0.185532 Apr 13 17:57:29 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 203/609] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:57:29 2023] DELETE /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments/2e5aab40-4eb4-44b3-a738-4f230bae10b3 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c501e148-ee23-4848-89b0-17f99ebe56ee tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c501e148-ee23-4848-89b0-17f99ebe56ee tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c501e148-ee23-4848-89b0-17f99ebe56ee tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c501e148-ee23-4848-89b0-17f99ebe56ee tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c501e148-ee23-4848-89b0-17f99ebe56ee tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c501e148-ee23-4848-89b0-17f99ebe56ee tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c501e148-ee23-4848-89b0-17f99ebe56ee tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c501e148-ee23-4848-89b0-17f99ebe56ee tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:29 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c501e148-ee23-4848-89b0-17f99ebe56ee tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055314 Apr 13 17:57:29 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 206/610] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:57:29 2023] GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:30 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:30 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:30 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0d6e5f59-5ab0-486e-9215-860ea235f12f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1658 microversion: 2.1 time: 0.260854 Apr 13 17:57:30 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 202/611] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:57:30 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1658 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:35 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-119f1277-e02c-48d7-8ea3-d6d421aa7014 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88" status: 200 len: 1503 microversion: 2.1 time: 0.155471 Apr 13 17:57:35 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 204/612] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:57:35 2023] GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] HTTP exception thrown: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Request method failure captured: Apr 13 17:57:37 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa HTTP/1.1 Apr 13 17:57:37 user devstack@n-api.service[61676]: Accept: application/json Apr 13 17:57:37 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 17:57:37 user devstack@n-api.service[61676]: Connection: close Apr 13 17:57:37 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 17:57:37 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 17:57:37 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 17:57:37 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 17:57:37 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEDYqmVnlAgUCmLuYjy-DdtqghFAC7wv4xG3zbcldYyLyz-e4f5FqUqId7VVr4lRPYC_WLZrpvqybyPcHw0TuMfLL_ZsVEvmlkOK8m2peGm5b7XMZJ6Uv1WDZHP1HkOlo3J9kzeWBnAiNUAp_wjw13DNwfiEOIVCiVNaNC7K-0xRd_M Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Project-Id: c3589c01630f4f83a6925d97943c574b Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Tenant-Id: c3589c01630f4f83a6925d97943c574b Apr 13 17:57:37 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 17:57:37 user devstack@n-api.service[61676]: X-User: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 17:57:37 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 17:57:37 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 17:57:37 user devstack@n-api.service[61676]: X-User-Id: 6be9926ecd1d45d89aba2e65ac3e0bfc Apr 13 17:57:37 user devstack@n-api.service[61676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 17:57:37 user devstack@n-api.service[61676]: method: > Apr 13 17:57:37 user devstack@n-api.service[61676]: exception: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 17:57:37 user devstack@n-api.service[61676]: action_args: {'id': '1753314b-bfd7-4e8b-986b-0253666ab8aa'} Apr 13 17:57:37 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 17:57:37 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 17:57:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Returning 404 to user: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:57:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-b624ec4b-4821-46ac-8f75-29938350423e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 404 len: 111 microversion: 2.20 time: 0.034730 Apr 13 17:57:37 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 207/613] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:57:37 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:57:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9f749322-5c4c-44f0-93cb-74376773531c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '.version_select at 0x7f82e23801f0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9f749322-5c4c-44f0-93cb-74376773531c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142800183" status: 204 len: 0 microversion: 2.20 time: 0.025163 Apr 13 17:57:37 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 203/614] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 17:57:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142800183 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 17:57:38 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-90a454bd-ba8e-4d19-96e2-51feb6b7b0ba tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'create', calling method: .version_select at 0x7f82e220d120>, body: {"keypair": {"name": "tempest-keypair-91694189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZyKsU5d3bmL/UYx8WaLL5HbYx/LyhlGbrsQ08rU0/9ERgJOpMA/oSP5ygT2oWoSAVJJWq6FEawBSbz8eCp+eykT1Y1DqGMQv/islvnWWLiXrHaPJ09U0W9Wfw/KjAghA=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:38 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-90a454bd-ba8e-4d19-96e2-51feb6b7b0ba tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting quotas for project c3589c01630f4f83a6925d97943c574b. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:57:38 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-90a454bd-ba8e-4d19-96e2-51feb6b7b0ba tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting quotas for user 6be9926ecd1d45d89aba2e65ac3e0bfc and project c3589c01630f4f83a6925d97943c574b. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:57:38 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-90a454bd-ba8e-4d19-96e2-51feb6b7b0ba tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.059644 Apr 13 17:57:38 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 205/615] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 17:57:38 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 17:57:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-634185266", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "41c99aae-50af-4003-92ae-c7c50e5f592d"}], "security_groups": [{"name": "tempest-securitygroup--1949183480"}], "key_name": "tempest-keypair-91694189", "user_data": "}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:40 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] validate_networks() for [('41c99aae-50af-4003-92ae-c7c50e5f592d', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting quotas for project c3589c01630f4f83a6925d97943c574b. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting quotas for user 6be9926ecd1d45d89aba2e65ac3e0bfc and project c3589c01630f4f83a6925d97943c574b. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:57:41 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:57:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.652670 Apr 13 17:57:41 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 208/616] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 17:57:40 2023] POST /compute/v2.1/servers => generated 400 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 17:57:41 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8d78996b-48de-4850-940c-ae2c5ee73953 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:41 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-8d78996b-48de-4850-940c-ae2c5ee73953 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:41 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:41 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-8d78996b-48de-4850-940c-ae2c5ee73953 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:41 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-8d78996b-48de-4850-940c-ae2c5ee73953 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:41 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-8d78996b-48de-4850-940c-ae2c5ee73953 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:41 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-8d78996b-48de-4850-940c-ae2c5ee73953 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 200 len: 1273 microversion: 2.20 time: 0.075079 Apr 13 17:57:41 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 204/617] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:57:41 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 1273 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:57:44 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] Creating event network-changed:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 17:57:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030551 Apr 13 17:57:44 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 206/618] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:57:46 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "name": "network-vif-plugged", "status": "completed", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:46 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:46 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:46 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:46 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:46 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=24 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:46 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] Creating event network-vif-plugged:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 17:57:46 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053125 Apr 13 17:57:46 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 209/619] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:57:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:48 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "name": "network-vif-plugged", "status": "completed", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:48 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:48 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] Creating event network-vif-plugged:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 17:57:48 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030773 Apr 13 17:57:48 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 205/620] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:57:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] HTTP exception thrown: Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 could not be found. Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Request method failure captured: Apr 13 17:57:53 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 HTTP/1.1 Apr 13 17:57:53 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:57:53 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:57:53 user devstack@n-api.service[61677]: Connection: close Apr 13 17:57:53 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:57:53 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:57:53 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:57:53 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:57:53 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEEUFMwDzsqsVZi_0J8iJSdUtcrtMMZbecjyum9n-tYJGY_BZibkpikDSy6FKwjht8aldAEH3uYU1CxkzBY2qA2_bC3EJKCb9CaaDmlFVYEZ4BI4-tLkAsT53kacDtlS1ZeWdX_Yr41GaOHtLZTQ9Jkdy1_UTSE5HFcggVf2low4hng Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Project-Id: 1775be5ea4c540b0a67bfe3468fd5901 Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestShelveInstance-2002875852 Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1775be5ea4c540b0a67bfe3468fd5901"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1775be5ea4c540b0a67bfe3468fd5901"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1775be5ea4c540b0a67bfe3468fd5901"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Tenant: tempest-TestShelveInstance-2002875852 Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Tenant-Id: 1775be5ea4c540b0a67bfe3468fd5901 Apr 13 17:57:53 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestShelveInstance-2002875852 Apr 13 17:57:53 user devstack@n-api.service[61677]: X-User: tempest-TestShelveInstance-2002875852-project-member Apr 13 17:57:53 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:57:53 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:57:53 user devstack@n-api.service[61677]: X-User-Id: 8b8e4096bfa5458b81aa51dc55394cb9 Apr 13 17:57:53 user devstack@n-api.service[61677]: X-User-Name: tempest-TestShelveInstance-2002875852-project-member Apr 13 17:57:53 user devstack@n-api.service[61677]: method: > Apr 13 17:57:53 user devstack@n-api.service[61677]: exception: Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 could not be found. Apr 13 17:57:53 user devstack@n-api.service[61677]: action_args: {'id': 'dc1716d8-163a-4a50-8b3a-dbde50340fb8'} Apr 13 17:57:53 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 could not be found. Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 could not be found. Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 could not be found. Apr 13 17:57:53 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:57:53 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Returning 404 to user: Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:57:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a9a896f5-dd56-468d-bae5-a4000285074a tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8" status: 404 len: 111 microversion: 2.1 time: 0.037643 Apr 13 17:57:53 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 207/621] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:57:53 2023] GET /compute/v2.1/servers/dc1716d8-163a-4a50-8b3a-dbde50340fb8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:57:53 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2822ec24-fe8d-46fe-a214-760ff33ba2a7 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Calling method '.version_select at 0x7f82e2331bd0>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:53 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:53 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2822ec24-fe8d-46fe-a214-760ff33ba2a7 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-822246976" status: 202 len: 0 microversion: 2.1 time: 0.035558 Apr 13 17:57:53 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 210/622] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 17:57:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-822246976 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2112694815", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] validate_networks() for None {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Getting quotas for project 896d3c28f5394d338751e9760b2bf797. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Getting quotas for user c7a49ea3332547cbb44e26d070ac91b6 and project 896d3c28f5394d338751e9760b2bf797. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:57:59 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:57:59 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.475793 Apr 13 17:57:59 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 206/623] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:57:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:57:59 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a9ca858b-3d2c-4ddd-a7a6-d5c5e3d2db3c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:57:59 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a9ca858b-3d2c-4ddd-a7a6-d5c5e3d2db3c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:57:59 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-a9ca858b-3d2c-4ddd-a7a6-d5c5e3d2db3c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a49ea3332547cbb44e26d070ac91b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d3c28f5394d338751e9760b2bf797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:57:59 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a9ca858b-3d2c-4ddd-a7a6-d5c5e3d2db3c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" status: 200 len: 1209 microversion: 2.1 time: 0.082069 Apr 13 17:57:59 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 208/624] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:57:59 2023] GET /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:58:02 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:02 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8", "tag": "054e541d-7046-460e-b183-8ea6906af1e0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:02 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] Creating event network-changed:054e541d-7046-460e-b183-8ea6906af1e0 for instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 on user Apr 13 17:58:02 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031428 Apr 13 17:58:02 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 211/625] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:58:04 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8", "name": "network-vif-plugged", "status": "completed", "tag": "054e541d-7046-460e-b183-8ea6906af1e0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] Creating event network-vif-plugged:054e541d-7046-460e-b183-8ea6906af1e0 for instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 on user Apr 13 17:58:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041668 Apr 13 17:58:05 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 207/626] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:07 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8", "name": "network-vif-plugged", "status": "completed", "tag": "054e541d-7046-460e-b183-8ea6906af1e0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:07 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:07 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:07 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] Creating event network-vif-plugged:054e541d-7046-460e-b183-8ea6906af1e0 for instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 on user Apr 13 17:58:07 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031228 Apr 13 17:58:07 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 209/627] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:11 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1427952535", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "8d9da666-0149-44ad-8f19-8f10afceca63"}]}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:11 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] validate_networks() for [('8d9da666-0149-44ad-8f19-8f10afceca63', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting quotas for project d533287b8269447aab81fa7d1312d3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting quotas for user ec5fc9c7b7234904ba39d403764420b3 and project d533287b8269447aab81fa7d1312d3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:58:12 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:58:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.716490 Apr 13 17:58:12 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 212/628] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 17:58:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 17:58:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-415797b6-ada2-4af6-9edb-98463762e990 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:12 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-415797b6-ada2-4af6-9edb-98463762e990 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:12 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-415797b6-ada2-4af6-9edb-98463762e990 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:12 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-415797b6-ada2-4af6-9edb-98463762e990 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:12 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-415797b6-ada2-4af6-9edb-98463762e990 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-415797b6-ada2-4af6-9edb-98463762e990 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06" status: 200 len: 1395 microversion: 2.87 time: 0.110851 Apr 13 17:58:12 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 208/629] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:58:12 2023] GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06 => generated 1395 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:58:16 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561b1fe2-f0d2-4966-b449-4a139e570f06", "tag": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] Creating event network-changed:c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance 561b1fe2-f0d2-4966-b449-4a139e570f06 on user Apr 13 17:58:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037589 Apr 13 17:58:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 210/630] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:18 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-46574d05-6795-4921-b4bc-be0e41b33373 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:18 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-46574d05-6795-4921-b4bc-be0e41b33373 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:18 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-46574d05-6795-4921-b4bc-be0e41b33373 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-46574d05-6795-4921-b4bc-be0e41b33373 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-46574d05-6795-4921-b4bc-be0e41b33373 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-46574d05-6795-4921-b4bc-be0e41b33373 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-46574d05-6795-4921-b4bc-be0e41b33373 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-46574d05-6795-4921-b4bc-be0e41b33373 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-46574d05-6795-4921-b4bc-be0e41b33373 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046943 Apr 13 17:58:18 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 213/631] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:58:18 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] HTTP exception thrown: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 is not attached to volume c60a8519-20b4-4b4e-8b21-368ebb46656e Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Request method failure captured: Apr 13 17:58:18 user devstack@n-api.service[61678]: request: DELETE /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments/c60a8519-20b4-4b4e-8b21-368ebb46656e HTTP/1.1 Apr 13 17:58:18 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:58:18 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:58:18 user devstack@n-api.service[61678]: Connection: close Apr 13 17:58:18 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:58:18 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:58:18 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:58:18 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:58:18 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEAm-0TEb7fc9lKCwp4mctd_3n1ealIlOB4ivtqhBhcctijvaZAwLfT1X09Em1gdkDoX0-rzVa6aHsKeY_olXX2T6_c2W7PSLrVIvwxW4TXP1Y8hs0nGGQjrz0M7F8ibyBUJM1TELui1AX1BUNETGX2iVDbZqt0tU5TaIcZgNh74cVA Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Project-Id: 88bc3754064947c89397db4a80161b3a Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Project-Name: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88bc3754064947c89397db4a80161b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88bc3754064947c89397db4a80161b3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88bc3754064947c89397db4a80161b3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Tenant: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Tenant-Id: 88bc3754064947c89397db4a80161b3a Apr 13 17:58:18 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:58:18 user devstack@n-api.service[61678]: X-User: tempest-TestMinimumBasicScenario-1587858147-project-member Apr 13 17:58:18 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:58:18 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:58:18 user devstack@n-api.service[61678]: X-User-Id: 8bdac67b9cc149b4b802c96fc87fc801 Apr 13 17:58:18 user devstack@n-api.service[61678]: X-User-Name: tempest-TestMinimumBasicScenario-1587858147-project-member Apr 13 17:58:18 user devstack@n-api.service[61678]: method: > Apr 13 17:58:18 user devstack@n-api.service[61678]: exception: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 is not attached to volume c60a8519-20b4-4b4e-8b21-368ebb46656e Apr 13 17:58:18 user devstack@n-api.service[61678]: action_args: {'server_id': '37a22063-cedb-45b0-8554-b1e60a7d4324', 'id': 'c60a8519-20b4-4b4e-8b21-368ebb46656e'} Apr 13 17:58:18 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c60a8519-20b4-4b4e-8b21-368ebb46656e. Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 is not attached to volume c60a8519-20b4-4b4e-8b21-368ebb46656e Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 is not attached to volume c60a8519-20b4-4b4e-8b21-368ebb46656e Apr 13 17:58:18 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:58:18 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Returning 404 to user: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 is not attached to volume c60a8519-20b4-4b4e-8b21-368ebb46656e {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:58:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-eecd8b05-a9fb-4fd7-a330-19f3d26e2cd8 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments/c60a8519-20b4-4b4e-8b21-368ebb46656e" status: 404 len: 154 microversion: 2.1 time: 0.121707 Apr 13 17:58:18 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 209/632] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:58:18 2023] DELETE /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324/os-volume_attachments/c60a8519-20b4-4b4e-8b21-368ebb46656e => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:58:18 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561b1fe2-f0d2-4966-b449-4a139e570f06", "name": "network-vif-plugged", "status": "completed", "tag": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:19 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] Creating event network-vif-plugged:c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance 561b1fe2-f0d2-4966-b449-4a139e570f06 on user Apr 13 17:58:19 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040314 Apr 13 17:58:19 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 211/633] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:19 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c342ddda-6310-4b82-9401-4b8f899e2c3f tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:19 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c342ddda-6310-4b82-9401-4b8f899e2c3f tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c342ddda-6310-4b82-9401-4b8f899e2c3f tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c342ddda-6310-4b82-9401-4b8f899e2c3f tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c342ddda-6310-4b82-9401-4b8f899e2c3f tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c342ddda-6310-4b82-9401-4b8f899e2c3f tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c342ddda-6310-4b82-9401-4b8f899e2c3f tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c342ddda-6310-4b82-9401-4b8f899e2c3f tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:19 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c342ddda-6310-4b82-9401-4b8f899e2c3f tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069433 Apr 13 17:58:19 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 214/634] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:58:19 2023] GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:58:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561b1fe2-f0d2-4966-b449-4a139e570f06", "name": "network-vif-plugged", "status": "completed", "tag": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] Creating event network-vif-plugged:c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance 561b1fe2-f0d2-4966-b449-4a139e570f06 on user Apr 13 17:58:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040568 Apr 13 17:58:21 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 210/635] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1778851942", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "9a7b2554-be2d-4da7-88fc-813febb6cd38", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d901aa48-1af6-4ded-9c70-e270315524cc"}]}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] validate_networks() for [('d901aa48-1af6-4ded-9c70-e270315524cc', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for user 1cd4d2b21dda452dab66c1973c3beec1 and project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:58:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9a7b2554-be2d-4da7-88fc-813febb6cd38',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:58:21 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:21 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1206725464"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:21 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:21 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:58:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.691385 Apr 13 17:58:22 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 212/636] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:58:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:58:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-6163bac9-27c8-4d0a-831d-3548e56fe68b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:22 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-6163bac9-27c8-4d0a-831d-3548e56fe68b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:22 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-6163bac9-27c8-4d0a-831d-3548e56fe68b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 204 len: 0 microversion: 2.1 time: 0.170609 Apr 13 17:58:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 215/637] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:58:21 2023] DELETE /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 17:58:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-6163bac9-27c8-4d0a-831d-3548e56fe68b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56" status: 200 len: 1052 microversion: 2.1 time: 0.092645 Apr 13 17:58:22 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 213/638] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:58:22 2023] GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 => generated 1052 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 17:58:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:22 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-9e91f6fd-3d1e-43b4-be9e-9fbed3ef77f9 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 200 len: 1543 microversion: 2.1 time: 0.286818 Apr 13 17:58:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 216/639] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:58:22 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 1543 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:58:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-unplugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] Creating event network-vif-unplugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:58:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039175 Apr 13 17:58:22 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 214/640] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:58:22 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:23 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/action" status: 202 len: 0 microversion: 2.1 time: 1.033575 Apr 13 17:58:23 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 211/641] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:58:21 2023] POST /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/action => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 17:58:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-deleted", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:23 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:23 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] Creating event network-vif-deleted:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:58:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037298 Apr 13 17:58:23 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 217/642] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-plugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}, {"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-plugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}, {"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-plugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}, {"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-unplugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}, {"server_uuid": "37a22063-cedb-45b0-8554-b1e60a7d4324", "name": "network-vif-plugged", "status": "completed", "tag": "c42e9982-60be-4b92-8ea1-460ff84f6a26"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Creating event network-vif-plugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:58:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Creating event network-vif-plugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:58:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Creating event network-vif-plugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:58:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Creating event network-vif-unplugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:58:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Creating event network-vif-plugged:c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 on user Apr 13 17:58:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037760 Apr 13 17:58:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 215/643] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:24 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a594110c-a772-408d-8650-b5f2ab1e5f56", "tag": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] Creating event network-changed:d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance a594110c-a772-408d-8650-b5f2ab1e5f56 on user Apr 13 17:58:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041725 Apr 13 17:58:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 212/644] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:29 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:29 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:29 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:29 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:29 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-d5aba389-17de-4ed6-bf91-f67d347e05bd tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1723 microversion: 2.1 time: 0.169086 Apr 13 17:58:29 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 218/645] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:58:29 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:58:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:29 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:29 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:29 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-757fa432-7fa1-4c0b-b5b7-435470d257cc tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1723 microversion: 2.1 time: 0.173370 Apr 13 17:58:29 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 216/646] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:58:29 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:58:31 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-359301831", "imageRef": "a530c0a0-c370-4663-9391-d6744c4948f9", "flavorRef": "42", "key_name": "tempest-TestStampPattern-712492187", "security_groups": [{"name": "tempest-secgroup-smoke-436240886"}], "networks": [{"uuid": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:31 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-7527c320-14ba-4d93-ae85-ed8e0c92c214 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-7527c320-14ba-4d93-ae85-ed8e0c92c214 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7527c320-14ba-4d93-ae85-ed8e0c92c214 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7527c320-14ba-4d93-ae85-ed8e0c92c214 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7527c320-14ba-4d93-ae85-ed8e0c92c214 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7527c320-14ba-4d93-ae85-ed8e0c92c214 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7527c320-14ba-4d93-ae85-ed8e0c92c214 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-7527c320-14ba-4d93-ae85-ed8e0c92c214 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:31 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-7527c320-14ba-4d93-ae85-ed8e0c92c214 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075051 Apr 13 17:58:31 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 219/647] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:58:31 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:31 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] validate_networks() for [('a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:58:31 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 204 len: 0 microversion: 2.1 time: 0.161019 Apr 13 17:58:31 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 220/648] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:58:31 2023] DELETE /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:31 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8e25d2fa-0a59-4192-beae-501d8ec32385 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 200 len: 1585 microversion: 2.20 time: 0.284995 Apr 13 17:58:31 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 217/649] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:58:31 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 1585 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:58:31 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:31 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-40bfce50-a845-42d7-9451-c632e2762c3e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 200 len: 1664 microversion: 2.1 time: 0.422737 Apr 13 17:58:31 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 221/650] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:58:31 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 1664 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting quotas for project 433b58054cc942efad3646ebf4ff286e. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting quotas for user 2b565bc35a4742808d360a395858134b and project 433b58054cc942efad3646ebf4ff286e. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:58:32 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a530c0a0-c370-4663-9391-d6744c4948f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:58:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.165906 Apr 13 17:58:32 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 213/651] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:58:31 2023] POST /compute/v2.1/servers => generated 403 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:58:32 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-128c84ff-d9bd-4dc5-9c36-02c188ecc1e8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:32 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-128c84ff-d9bd-4dc5-9c36-02c188ecc1e8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:32 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:32 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=8 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:32 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-128c84ff-d9bd-4dc5-9c36-02c188ecc1e8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-128c84ff-d9bd-4dc5-9c36-02c188ecc1e8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712" status: 200 len: 1235 microversion: 2.1 time: 0.327985 Apr 13 17:58:32 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 218/652] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:58:32 2023] GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => generated 1235 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:58:32 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-unplugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:32 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] Creating event network-vif-unplugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:58:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044825 Apr 13 17:58:32 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 222/653] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-a140b089-729e-40ce-95bd-f8c7eaabc7ce req-fc548a2f-a04f-4801-ad3f-3f3dbf4066ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-deleted", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a140b089-729e-40ce-95bd-f8c7eaabc7ce req-fc548a2f-a04f-4801-ad3f-3f3dbf4066ec service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a140b089-729e-40ce-95bd-f8c7eaabc7ce req-fc548a2f-a04f-4801-ad3f-3f3dbf4066ec service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a140b089-729e-40ce-95bd-f8c7eaabc7ce req-fc548a2f-a04f-4801-ad3f-3f3dbf4066ec service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a140b089-729e-40ce-95bd-f8c7eaabc7ce req-fc548a2f-a04f-4801-ad3f-3f3dbf4066ec service nova] Creating event network-vif-deleted:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:58:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-a140b089-729e-40ce-95bd-f8c7eaabc7ce req-fc548a2f-a04f-4801-ad3f-3f3dbf4066ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052825 Apr 13 17:58:33 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 214/654] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:34 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfd107b-fef8-4acf-9a2c-1861aabacfe9", "name": "network-vif-plugged", "status": "completed", "tag": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] Creating event network-vif-plugged:723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 on user Apr 13 17:58:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041573 Apr 13 17:58:34 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 219/655] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d7146a-14c1-4dc2-9e98-d1f05bbf3712", "tag": "a494221d-1460-48b2-9a60-b2329efbf6bc"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] Creating event network-changed:a494221d-1460-48b2-9a60-b2329efbf6bc for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 on user Apr 13 17:58:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039170 Apr 13 17:58:35 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 223/656] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0626b08c-752f-4e2c-ba68-586ce94e19fc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'create', calling method: .version_select at 0x7f82e2426950>, body: {"keypair": {"name": "tempest-keypair-1158147748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWBsAPFHL1kEqtOmPsrJKB5vYho0rsY7MM2yfOo6HwS5Wp/30YJfBntr9RLJhPsW7Wt1wJtGkjLqIJ5RG3sY6B0IKcGOd0soxtl42k1xZK+fo8pt+njadFWbmK0xi8LMQ=="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:38 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-0626b08c-752f-4e2c-ba68-586ce94e19fc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting quotas for project c97ac3ae1ebe4107a05bd27710b9502b. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:58:38 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-0626b08c-752f-4e2c-ba68-586ce94e19fc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting quotas for user 8f1fe2e6fd894d5c87d7ccf5fae553ca and project c97ac3ae1ebe4107a05bd27710b9502b. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:58:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0626b08c-752f-4e2c-ba68-586ce94e19fc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045800 Apr 13 17:58:38 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 215/657] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:58:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:39 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d7146a-14c1-4dc2-9e98-d1f05bbf3712", "name": "network-vif-plugged", "status": "completed", "tag": "a494221d-1460-48b2-9a60-b2329efbf6bc"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:39 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:39 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=27 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:58:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] Creating event network-vif-plugged:a494221d-1460-48b2-9a60-b2329efbf6bc for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 on user Apr 13 17:58:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034489 Apr 13 17:58:39 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 220/658] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:39 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a594110c-a772-408d-8650-b5f2ab1e5f56", "name": "network-vif-plugged", "status": "completed", "tag": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:39 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] Creating event network-vif-plugged:d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance a594110c-a772-408d-8650-b5f2ab1e5f56 on user Apr 13 17:58:39 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033985 Apr 13 17:58:39 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 224/659] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-320463142", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d619c2d2-220f-43dd-b31d-8f5d0254fc27"}], "security_groups": [{"name": "tempest-securitygroup--1608493795"}], "key_name": "tempest-keypair-1158147748", "user_data": "}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] validate_networks() for [('d619c2d2-220f-43dd-b31d-8f5d0254fc27', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting quotas for project c97ac3ae1ebe4107a05bd27710b9502b. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting quotas for user 8f1fe2e6fd894d5c87d7ccf5fae553ca and project c97ac3ae1ebe4107a05bd27710b9502b. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:58:40 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:58:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.634490 Apr 13 17:58:40 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 216/660] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:58:40 2023] POST /compute/v2.1/servers => generated 407 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:58:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2fd40b95-c09a-459b-861b-233ed358014a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2fd40b95-c09a-459b-861b-233ed358014a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:40 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-2fd40b95-c09a-459b-861b-233ed358014a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2fd40b95-c09a-459b-861b-233ed358014a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374" status: 200 len: 1239 microversion: 2.1 time: 0.065061 Apr 13 17:58:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 221/661] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:58:40 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:58:41 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d7146a-14c1-4dc2-9e98-d1f05bbf3712", "name": "network-vif-plugged", "status": "completed", "tag": "a494221d-1460-48b2-9a60-b2329efbf6bc"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] Creating event network-vif-plugged:a494221d-1460-48b2-9a60-b2329efbf6bc for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 on user Apr 13 17:58:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031088 Apr 13 17:58:41 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 225/662] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:41 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a594110c-a772-408d-8650-b5f2ab1e5f56", "name": "network-vif-plugged", "status": "completed", "tag": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:41 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] Creating event network-vif-plugged:d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance a594110c-a772-408d-8650-b5f2ab1e5f56 on user Apr 13 17:58:41 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032251 Apr 13 17:58:41 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 217/663] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:43 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:43 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] Creating event network-changed:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 17:58:43 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031603 Apr 13 17:58:43 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 222/664] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-plugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] Creating event network-vif-plugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 17:58:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034852 Apr 13 17:58:45 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 226/665] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-plugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:58:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] Creating event network-vif-plugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 17:58:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033786 Apr 13 17:58:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 218/666] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:58:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:58:49 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:58:49 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:58:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:58:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:58:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:58:50 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a49ea3332547cbb44e26d070ac91b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d3c28f5394d338751e9760b2bf797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:58:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-87452b6f-ee25-44da-a04e-1ad6128a406c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" status: 200 len: 1455 microversion: 2.1 time: 0.346575 Apr 13 17:58:50 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 223/667] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:58:49 2023] GET /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 => generated 1455 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=9 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:02 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:03 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:03 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f4f01634-186e-4bf6-b1a2-4d3d4ecbf239 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06" status: 200 len: 1691 microversion: 2.87 time: 0.176203 Apr 13 17:59:03 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 227/668] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:59:02 2023] GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=16 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=7 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:12 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0969e1cc-3664-4bb1-a5cc-fb2cee86c650 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56" status: 200 len: 1378 microversion: 2.1 time: 0.160207 Apr 13 17:59:12 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 219/669] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:59:12 2023] GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 => generated 1378 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=9 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=9 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:12 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] HTTP exception thrown: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 could not be found. Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Request method failure captured: Apr 13 17:59:12 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 HTTP/1.1 Apr 13 17:59:12 user devstack@n-api.service[61677]: Accept: application/json Apr 13 17:59:12 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 17:59:12 user devstack@n-api.service[61677]: Connection: close Apr 13 17:59:12 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 17:59:12 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 17:59:12 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 17:59:12 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 17:59:12 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEAm-0TEb7fc9lKCwp4mctd_3n1ealIlOB4ivtqhBhcctijvaZAwLfT1X09Em1gdkDoX0-rzVa6aHsKeY_olXX2T6_c2W7PSLrVIvwxW4TXP1Y8hs0nGGQjrz0M7F8ibyBUJM1TELui1AX1BUNETGX2iVDbZqt0tU5TaIcZgNh74cVA Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Project-Id: 88bc3754064947c89397db4a80161b3a Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88bc3754064947c89397db4a80161b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88bc3754064947c89397db4a80161b3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88bc3754064947c89397db4a80161b3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Tenant: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Tenant-Id: 88bc3754064947c89397db4a80161b3a Apr 13 17:59:12 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1587858147 Apr 13 17:59:12 user devstack@n-api.service[61677]: X-User: tempest-TestMinimumBasicScenario-1587858147-project-member Apr 13 17:59:12 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 17:59:12 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 17:59:12 user devstack@n-api.service[61677]: X-User-Id: 8bdac67b9cc149b4b802c96fc87fc801 Apr 13 17:59:12 user devstack@n-api.service[61677]: X-User-Name: tempest-TestMinimumBasicScenario-1587858147-project-member Apr 13 17:59:12 user devstack@n-api.service[61677]: method: > Apr 13 17:59:12 user devstack@n-api.service[61677]: exception: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 could not be found. Apr 13 17:59:12 user devstack@n-api.service[61677]: action_args: {'id': '37a22063-cedb-45b0-8554-b1e60a7d4324'} Apr 13 17:59:12 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 could not be found. Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 could not be found. Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 could not be found. Apr 13 17:59:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 17:59:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Returning 404 to user: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:59:12 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-60bc9785-2a3f-48f4-acc8-4d2084f83e02 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324" status: 404 len: 111 microversion: 2.1 time: 0.040182 Apr 13 17:59:12 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 224/670] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:59:12 2023] GET /compute/v2.1/servers/37a22063-cedb-45b0-8554-b1e60a7d4324 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:59:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-de1c7da3-e938-49e1-92a1-1a37d892651d tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Calling method '.version_select at 0x7f82e217e320>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-de1c7da3-e938-49e1-92a1-1a37d892651d tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-969682718" status: 202 len: 0 microversion: 2.1 time: 0.024958 Apr 13 17:59:12 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 228/671] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 13 17:59:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-969682718 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HTTP exception thrown: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Request method failure captured: Apr 13 17:59:21 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 HTTP/1.1 Apr 13 17:59:21 user devstack@n-api.service[61678]: Accept: application/json Apr 13 17:59:21 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 17:59:21 user devstack@n-api.service[61678]: Connection: close Apr 13 17:59:21 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 17:59:21 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 17:59:21 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 17:59:21 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 17:59:21 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOECNjxnA2Xl2crGLWMHF48XkKEhzAWqqun6kWJY-bYak5b7nj1LPmhgt6asPvC8BrmVMxxB9-5IoXNCqHea27biR0vgDC6Kgnwy8FBTjmy_mrBHmGkgcKZm20QrOv-P4WyJS3piwkZQ1RMJcfC4LINKcdRnRcU-NIoxYeXdoDfUp3Fg Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Project-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeTestJSON-2087525588 Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Tenant-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 17:59:21 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 17:59:21 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 17:59:21 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 17:59:21 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 17:59:21 user devstack@n-api.service[61678]: X-User-Id: 91769944ac8048dbb1f418d232e670d3 Apr 13 17:59:21 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 17:59:21 user devstack@n-api.service[61678]: method: > Apr 13 17:59:21 user devstack@n-api.service[61678]: exception: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 17:59:21 user devstack@n-api.service[61678]: action_args: {'id': 'bcfd107b-fef8-4acf-9a2c-1861aabacfe9'} Apr 13 17:59:21 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 17:59:21 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 17:59:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Returning 404 to user: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:59:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9ffcb6cb-cf2d-41e8-878d-c2a58ec4923a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 404 len: 111 microversion: 2.1 time: 0.028122 Apr 13 17:59:21 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 220/672] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:59:21 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:59:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-15c010f0-cb84-4146-aa99-a2d50826ecc4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '.version_select at 0x7f82e23c9f30>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-15c010f0-cb84-4146-aa99-a2d50826ecc4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430946118" status: 202 len: 0 microversion: 2.1 time: 0.023210 Apr 13 17:59:22 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 225/673] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 17:59:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430946118 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:22 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-72dc0b60-bc3a-4d7f-96f8-c9481ae050af tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'create', calling method: .version_select at 0x7f82e249bd00>, body: {"keypair": {"name": "tempest-keypair-1877620197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+YgyiVk19kdaRjmu/uchZVpegteCHORgIR7ZHx/HQsZEpme4M4xwCCZxpEapxFRZcdjPYDWFEZ6h5hweGRRJKYFR156zpNQbuH12loKVtDCwW2nHgO6zKHfJTAmpolhw=="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:22 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-72dc0b60-bc3a-4d7f-96f8-c9481ae050af tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting quotas for project 5ee8ad9e1bc74eb9b9997f7706d3f096. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:59:22 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-72dc0b60-bc3a-4d7f-96f8-c9481ae050af tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting quotas for user 91769944ac8048dbb1f418d232e670d3 and project 5ee8ad9e1bc74eb9b9997f7706d3f096. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:59:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-72dc0b60-bc3a-4d7f-96f8-c9481ae050af tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053705 Apr 13 17:59:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 221/674] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:59:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:22 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-8b696c21-968f-40d0-b417-b2899eba9b25 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712" status: 200 len: 1536 microversion: 2.1 time: 0.195192 Apr 13 17:59:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 229/675] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:59:22 2023] GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => generated 1536 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:59:24 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1049189686", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "32c8d5d5-0fc7-4585-ab35-0b352781dc66"}], "security_groups": [{"name": "tempest-securitygroup--2005641923"}], "key_name": "tempest-keypair-1877620197", "user_data": "}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:24 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] validate_networks() for [('32c8d5d5-0fc7-4585-ab35-0b352781dc66', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting quotas for project 5ee8ad9e1bc74eb9b9997f7706d3f096. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting quotas for user 91769944ac8048dbb1f418d232e670d3 and project 5ee8ad9e1bc74eb9b9997f7706d3f096. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:59:25 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:59:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.596290 Apr 13 17:59:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 226/676] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:59:24 2023] POST /compute/v2.1/servers => generated 400 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:59:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-11305e74-7f84-4e73-986c-81e3f8c31617 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:25 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-11305e74-7f84-4e73-986c-81e3f8c31617 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:25 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-11305e74-7f84-4e73-986c-81e3f8c31617 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-11305e74-7f84-4e73-986c-81e3f8c31617 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1" status: 200 len: 1232 microversion: 2.1 time: 0.084915 Apr 13 17:59:25 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 222/677] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:59:25 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 => generated 1232 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:59:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3137ec3f-cb47-4ec9-8321-c6a2486633e1", "tag": "d86c3ad7-5ef2-4356-9a80-5bcf35099658"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] Creating event network-changed:d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 on user Apr 13 17:59:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029479 Apr 13 17:59:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 230/678] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:29 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3137ec3f-cb47-4ec9-8321-c6a2486633e1", "name": "network-vif-plugged", "status": "completed", "tag": "d86c3ad7-5ef2-4356-9a80-5bcf35099658"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:29 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:29 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] Creating event network-vif-plugged:d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 on user Apr 13 17:59:29 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033878 Apr 13 17:59:29 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 227/679] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:29 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:29 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:29 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:30 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:59:30 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 204 len: 0 microversion: 2.1 time: 0.147503 Apr 13 17:59:30 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 223/680] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:59:29 2023] DELETE /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:59:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:30 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:30 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-8917fcc4-fc05-49cc-a5b5-7644434838a7 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 200 len: 1729 microversion: 2.1 time: 0.196520 Apr 13 17:59:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 231/681] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:59:30 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:59:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-unplugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] Creating event network-vif-unplugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:59:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047492 Apr 13 17:59:30 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 228/682] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:30 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:30 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:31 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ad3bbd1a-2d5a-46b6-a6f8-d189bf155884 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374" status: 200 len: 1553 microversion: 2.1 time: 0.294979 Apr 13 17:59:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 224/683] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:59:30 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:59:31 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0db18c77-a81c-4776-aa3b-8c8700f8e82e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:31 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0db18c77-a81c-4776-aa3b-8c8700f8e82e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0db18c77-a81c-4776-aa3b-8c8700f8e82e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0db18c77-a81c-4776-aa3b-8c8700f8e82e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0db18c77-a81c-4776-aa3b-8c8700f8e82e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0db18c77-a81c-4776-aa3b-8c8700f8e82e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0db18c77-a81c-4776-aa3b-8c8700f8e82e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:31 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0db18c77-a81c-4776-aa3b-8c8700f8e82e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3137ec3f-cb47-4ec9-8321-c6a2486633e1", "name": "network-vif-plugged", "status": "completed", "tag": "d86c3ad7-5ef2-4356-9a80-5bcf35099658"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] Creating event network-vif-plugged:d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 on user Apr 13 17:59:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037894 Apr 13 17:59:31 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 229/684] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:31 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0db18c77-a81c-4776-aa3b-8c8700f8e82e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.155334 Apr 13 17:59:31 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 232/685] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 17:59:31 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/os-interface => generated 282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:59:32 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-plugged", "status": "completed", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}, {"server_uuid": "08984ef0-6db9-4a60-b5b9-a6325ec531b1", "name": "network-vif-deleted", "tag": "067fbe09-ace1-4188-a99f-ee4847a1a311"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] Creating event network-vif-plugged:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:59:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] Creating event network-vif-deleted:067fbe09-ace1-4188-a99f-ee4847a1a311 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 on user Apr 13 17:59:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033566 Apr 13 17:59:32 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 225/686] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:32 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:32 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:32 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:32 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] Creating event network-changed:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 17:59:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045721 Apr 13 17:59:32 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 230/687] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:32 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-df0bf22d-ba94-48b7-8ddf-cac343217bfd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:32 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-df0bf22d-ba94-48b7-8ddf-cac343217bfd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-df0bf22d-ba94-48b7-8ddf-cac343217bfd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-df0bf22d-ba94-48b7-8ddf-cac343217bfd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-df0bf22d-ba94-48b7-8ddf-cac343217bfd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-df0bf22d-ba94-48b7-8ddf-cac343217bfd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-df0bf22d-ba94-48b7-8ddf-cac343217bfd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-df0bf22d-ba94-48b7-8ddf-cac343217bfd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-df0bf22d-ba94-48b7-8ddf-cac343217bfd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/ips" status: 200 len: 110 microversion: 2.20 time: 0.052549 Apr 13 17:59:32 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 233/688] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 17:59:32 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/ips => generated 110 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 17:59:34 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:34 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:34 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'flavor' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:59:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/action" status: 202 len: 0 microversion: 2.20 time: 0.845178 Apr 13 17:59:35 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 226/689] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 17:59:34 2023] POST /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/action => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "name": "network-vif-unplugged", "status": "completed", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] Creating event network-vif-unplugged:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 17:59:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032335 Apr 13 17:59:35 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 234/690] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:35 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-048e20a7-9216-45af-89d1-27f735157720 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 200 len: 1710 microversion: 2.20 time: 0.620389 Apr 13 17:59:35 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 231/691] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 17:59:35 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 1710 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 17:59:37 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "name": "network-vif-plugged", "status": "completed", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] Creating event network-vif-plugged:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 17:59:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037151 Apr 13 17:59:37 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 227/692] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] Creating event network-changed:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 17:59:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037712 Apr 13 17:59:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 235/693] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=16 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:50 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:59:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" status: 204 len: 0 microversion: 2.1 time: 0.143997 Apr 13 17:59:50 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 232/694] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:59:50 2023] DELETE /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:50 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a49ea3332547cbb44e26d070ac91b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d3c28f5394d338751e9760b2bf797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:59:50 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-93301df1-7a38-46ef-a499-2838de402e10 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" status: 200 len: 1461 microversion: 2.1 time: 0.207165 Apr 13 17:59:50 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 228/695] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:59:50 2023] GET /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 => generated 1461 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:59:50 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=14 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:50 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=26 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:59:50 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8", "name": "network-vif-unplugged", "status": "completed", "tag": "054e541d-7046-460e-b183-8ea6906af1e0"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:50 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] Creating event network-vif-unplugged:054e541d-7046-460e-b183-8ea6906af1e0 for instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 on user Apr 13 17:59:50 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033497 Apr 13 17:59:50 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 236/696] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:59:51 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-4b12dab3-fd3b-42bb-a1b9-f84687ef5057 req-41435fe2-315d-4459-902f-24db55a80ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8", "name": "network-vif-deleted", "tag": "054e541d-7046-460e-b183-8ea6906af1e0"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:51 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4b12dab3-fd3b-42bb-a1b9-f84687ef5057 req-41435fe2-315d-4459-902f-24db55a80ebf service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:51 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4b12dab3-fd3b-42bb-a1b9-f84687ef5057 req-41435fe2-315d-4459-902f-24db55a80ebf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:51 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4b12dab3-fd3b-42bb-a1b9-f84687ef5057 req-41435fe2-315d-4459-902f-24db55a80ebf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:51 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4b12dab3-fd3b-42bb-a1b9-f84687ef5057 req-41435fe2-315d-4459-902f-24db55a80ebf service nova] Creating event network-vif-deleted:054e541d-7046-460e-b183-8ea6906af1e0 for instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 on user Apr 13 17:59:51 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-4b12dab3-fd3b-42bb-a1b9-f84687ef5057 req-41435fe2-315d-4459-902f-24db55a80ebf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038365 Apr 13 17:59:51 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 233/697] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:59:52 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8", "name": "network-vif-plugged", "status": "completed", "tag": "054e541d-7046-460e-b183-8ea6906af1e0"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:59:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:59:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:59:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:59:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] Creating event network-vif-plugged:054e541d-7046-460e-b183-8ea6906af1e0 for instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 on user Apr 13 17:59:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030975 Apr 13 17:59:52 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 229/698] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:59:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-432969407"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06/action" status: 202 len: 52 microversion: 2.87 time: 0.805669 Apr 13 18:00:03 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 237/699] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 18:00:03 2023] POST /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06/action => generated 52 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:09 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:09 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-dc7f0f73-f0f9-43de-8d6f-23d8a516465d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06" status: 200 len: 1691 microversion: 2.87 time: 0.170773 Apr 13 18:00:09 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 234/700] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:00:09 2023] GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=8 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:12 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-545a50d3-ef81-460d-a263-158b480ecf80 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56" status: 200 len: 1378 microversion: 2.1 time: 0.190560 Apr 13 18:00:12 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 230/701] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:12 2023] GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 => generated 1378 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:00:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:12 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:13 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:13 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1b4c13ce-cca1-4bab-9538-ea213abf6c1b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56" status: 200 len: 1378 microversion: 2.1 time: 0.508293 Apr 13 18:00:13 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 238/702] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:12 2023] GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 => generated 1378 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:00:13 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:13 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:13 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:00:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56" status: 204 len: 0 microversion: 2.1 time: 0.111239 Apr 13 18:00:13 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 235/703] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:00:13 2023] DELETE /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:00:13 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:13 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:13 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-28ff3eb0-2772-42da-9b68-87f7380306a2 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56" status: 200 len: 1384 microversion: 2.1 time: 0.172161 Apr 13 18:00:13 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 231/704] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:13 2023] GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 => generated 1384 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:00:13 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a594110c-a772-408d-8650-b5f2ab1e5f56", "name": "network-vif-unplugged", "status": "completed", "tag": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:13 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] Creating event network-vif-unplugged:d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance a594110c-a772-408d-8650-b5f2ab1e5f56 on user Apr 13 18:00:13 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031943 Apr 13 18:00:13 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 239/705] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:14 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a594110c-a772-408d-8650-b5f2ab1e5f56", "name": "network-vif-deleted", "tag": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:14 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] Creating event network-vif-deleted:d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance a594110c-a772-408d-8650-b5f2ab1e5f56 on user Apr 13 18:00:14 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028942 Apr 13 18:00:14 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 236/706] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:15 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:15 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-dbfb8117-a94b-438d-9358-2cf4470b5e95 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1" status: 200 len: 1538 microversion: 2.1 time: 0.267800 Apr 13 18:00:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 232/707] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:15 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 => generated 1538 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:00:15 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a594110c-a772-408d-8650-b5f2ab1e5f56", "name": "network-vif-plugged", "status": "completed", "tag": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] Creating event network-vif-plugged:d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance a594110c-a772-408d-8650-b5f2ab1e5f56 on user Apr 13 18:00:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051398 Apr 13 18:00:15 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 240/708] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:20 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HTTP exception thrown: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Request method failure captured: Apr 13 18:00:20 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 HTTP/1.1 Apr 13 18:00:20 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:00:20 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:00:20 user devstack@n-api.service[61677]: Connection: close Apr 13 18:00:20 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:00:20 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:00:20 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:00:20 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:00:20 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_KuZSegvidCvRbvLaWYJtxrMth6brUAavIfruxyjoIdg_JGfICN_OYG4QHZhz3lkAlr0aaEzzkZsMRdGMC5NK-EdthloS_EdCdi9vddKhAWENSZQ8vvbTogFPMqE6u-5sy96xNBmFyoz5pySm6MuJZ5vvpuo1cg27qG46NmkzWnYs Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Project-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Project-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Tenant: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Tenant-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:00:20 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:00:20 user devstack@n-api.service[61677]: X-User: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:00:20 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:00:20 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:00:20 user devstack@n-api.service[61677]: X-User-Id: 8f796555c0e242d091502725ec595c0f Apr 13 18:00:20 user devstack@n-api.service[61677]: X-User-Name: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:00:20 user devstack@n-api.service[61677]: method: > Apr 13 18:00:20 user devstack@n-api.service[61677]: exception: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61677]: action_args: {'id': '08984ef0-6db9-4a60-b5b9-a6325ec531b1'} Apr 13 18:00:20 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Returning 404 to user: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:00:20 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-c65f3512-e105-4aa6-9a4e-3783bd35c12a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 404 len: 111 microversion: 2.1 time: 0.029752 Apr 13 18:00:20 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 237/709] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:20 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HTTP exception thrown: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Request method failure captured: Apr 13 18:00:20 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments HTTP/1.1 Apr 13 18:00:20 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:00:20 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:00:20 user devstack@n-api.service[61678]: Connection: close Apr 13 18:00:20 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:00:20 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:00:20 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:00:20 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:00:20 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_KuZSegvidCvRbvLaWYJtxrMth6brUAavIfruxyjoIdg_JGfICN_OYG4QHZhz3lkAlr0aaEzzkZsMRdGMC5NK-EdthloS_EdCdi9vddKhAWENSZQ8vvbTogFPMqE6u-5sy96xNBmFyoz5pySm6MuJZ5vvpuo1cg27qG46NmkzWnYs Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Project-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Project-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Tenant: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Tenant-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:00:20 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:00:20 user devstack@n-api.service[61678]: X-User: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:00:20 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:00:20 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:00:20 user devstack@n-api.service[61678]: X-User-Id: 8f796555c0e242d091502725ec595c0f Apr 13 18:00:20 user devstack@n-api.service[61678]: X-User-Name: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:00:20 user devstack@n-api.service[61678]: method: > Apr 13 18:00:20 user devstack@n-api.service[61678]: exception: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61678]: action_args: {'server_id': '08984ef0-6db9-4a60-b5b9-a6325ec531b1'} Apr 13 18:00:20 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Returning 404 to user: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:00:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-8b03260b-d132-443b-9470-ada40f768d25 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032691 Apr 13 18:00:20 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 233/710] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:00:20 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:20 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HTTP exception thrown: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Request method failure captured: Apr 13 18:00:20 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 HTTP/1.1 Apr 13 18:00:20 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:00:20 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:00:20 user devstack@n-api.service[61676]: Connection: close Apr 13 18:00:20 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:00:20 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:00:20 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:00:20 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:00:20 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_KuZSegvidCvRbvLaWYJtxrMth6brUAavIfruxyjoIdg_JGfICN_OYG4QHZhz3lkAlr0aaEzzkZsMRdGMC5NK-EdthloS_EdCdi9vddKhAWENSZQ8vvbTogFPMqE6u-5sy96xNBmFyoz5pySm6MuJZ5vvpuo1cg27qG46NmkzWnYs Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Project-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Project-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Tenant: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Tenant-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:00:20 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:00:20 user devstack@n-api.service[61676]: X-User: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:00:20 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:00:20 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:00:20 user devstack@n-api.service[61676]: X-User-Id: 8f796555c0e242d091502725ec595c0f Apr 13 18:00:20 user devstack@n-api.service[61676]: X-User-Name: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:00:20 user devstack@n-api.service[61676]: method: > Apr 13 18:00:20 user devstack@n-api.service[61676]: exception: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61676]: action_args: {'id': '08984ef0-6db9-4a60-b5b9-a6325ec531b1'} Apr 13 18:00:20 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:00:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Returning 404 to user: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:00:20 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-99124c1b-3c62-42bc-a3cb-b9992a276834 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 404 len: 111 microversion: 2.1 time: 0.031816 Apr 13 18:00:20 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 241/711] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:20 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-935220888", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "10638cc2-22a6-4aac-b79a-2baa9327e1bc"}], "security_groups": [{"name": "tempest-securitygroup--2068620042"}], "key_name": "tempest-keypair-1272899020", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:20 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] validate_networks() for [('10638cc2-22a6-4aac-b79a-2baa9327e1bc', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for user 8f796555c0e242d091502725ec595c0f and project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:00:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:00:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.572364 Apr 13 18:00:21 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 238/712] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:00:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:00:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-1d4da57e-47ba-4633-a054-305d712c213f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:21 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-1d4da57e-47ba-4633-a054-305d712c213f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:21 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-1d4da57e-47ba-4633-a054-305d712c213f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-1d4da57e-47ba-4633-a054-305d712c213f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4" status: 200 len: 1232 microversion: 2.1 time: 0.065710 Apr 13 18:00:21 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 234/713] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:21 2023] GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4 => generated 1232 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:00:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:23 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:23 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-636f9baa-884f-43ca-a474-9e186620adbd tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712" status: 200 len: 1536 microversion: 2.1 time: 0.374716 Apr 13 18:00:23 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 242/714] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:22 2023] GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => generated 1536 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:00:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b75d41c6-6cf6-4162-b49b-c3205c128ef4", "tag": "54109c72-9d87-44b7-a358-864c31b9c96d"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] Creating event network-changed:54109c72-9d87-44b7-a358-864c31b9c96d for instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 on user Apr 13 18:00:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032849 Apr 13 18:00:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 239/715] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d7146a-14c1-4dc2-9e98-d1f05bbf3712", "tag": "a494221d-1460-48b2-9a60-b2329efbf6bc"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] Creating event network-changed:a494221d-1460-48b2-9a60-b2329efbf6bc for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 on user Apr 13 18:00:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044984 Apr 13 18:00:25 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 235/716] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:25 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "008f5615-748c-4a5f-9e50-db5b9f3aad89"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:25 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:25 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "POST /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308043 Apr 13 18:00:25 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 243/717] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:00:25 2023] POST /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:25 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b75d41c6-6cf6-4162-b49b-c3205c128ef4", "name": "network-vif-plugged", "status": "completed", "tag": "54109c72-9d87-44b7-a358-864c31b9c96d"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:26 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:26 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:26 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:26 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8f59ae35-61f7-4232-af62-02c9c333f705 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 200 len: 1651 microversion: 2.20 time: 0.346970 Apr 13 18:00:26 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 240/718] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:00:25 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 1651 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:00:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] Creating event network-vif-plugged:54109c72-9d87-44b7-a358-864c31b9c96d for instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 on user Apr 13 18:00:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041247 Apr 13 18:00:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 236/719] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:28 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b75d41c6-6cf6-4162-b49b-c3205c128ef4", "name": "network-vif-plugged", "status": "completed", "tag": "54109c72-9d87-44b7-a358-864c31b9c96d"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:28 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:28 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] Creating event network-vif-plugged:54109c72-9d87-44b7-a358-864c31b9c96d for instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 on user Apr 13 18:00:28 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028728 Apr 13 18:00:28 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 244/720] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-65c2a9cf-a4a8-4961-843e-b2e8c9c046b2 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-65c2a9cf-a4a8-4961-843e-b2e8c9c046b2 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-65c2a9cf-a4a8-4961-843e-b2e8c9c046b2 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-65c2a9cf-a4a8-4961-843e-b2e8c9c046b2 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-65c2a9cf-a4a8-4961-843e-b2e8c9c046b2 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-65c2a9cf-a4a8-4961-843e-b2e8c9c046b2 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-65c2a9cf-a4a8-4961-843e-b2e8c9c046b2 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-65c2a9cf-a4a8-4961-843e-b2e8c9c046b2 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:31 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-65c2a9cf-a4a8-4961-843e-b2e8c9c046b2 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.151022 Apr 13 18:00:31 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 241/721] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:00:31 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-interface => generated 283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:32 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:32 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] Creating event network-changed:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:00:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069984 Apr 13 18:00:32 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 237/722] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:32 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:32 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376443 Apr 13 18:00:32 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 245/723] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:00:32 2023] POST /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:33 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:34 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'services' on Instance uuid 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:00:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/os-volume_attachments/008f5615-748c-4a5f-9e50-db5b9f3aad89" status: 202 len: 0 microversion: 2.1 time: 0.290498 Apr 13 18:00:34 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 242/724] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:00:33 2023] DELETE /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/os-volume_attachments/008f5615-748c-4a5f-9e50-db5b9f3aad89 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:00:34 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-2dbb2cd8-9ff8-43d1-854a-0012a687a441 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:34 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-2dbb2cd8-9ff8-43d1-854a-0012a687a441 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2dbb2cd8-9ff8-43d1-854a-0012a687a441 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2dbb2cd8-9ff8-43d1-854a-0012a687a441 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2dbb2cd8-9ff8-43d1-854a-0012a687a441 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2dbb2cd8-9ff8-43d1-854a-0012a687a441 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2dbb2cd8-9ff8-43d1-854a-0012a687a441 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:34 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2dbb2cd8-9ff8-43d1-854a-0012a687a441 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:34 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-2dbb2cd8-9ff8-43d1-854a-0012a687a441 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053017 Apr 13 18:00:34 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 238/725] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:00:34 2023] GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=19 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] HTTP exception thrown: Instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 could not be found. Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Request method failure captured: Apr 13 18:00:40 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 HTTP/1.1 Apr 13 18:00:40 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:00:40 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:00:40 user devstack@n-api.service[61676]: Connection: close Apr 13 18:00:40 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:00:40 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:00:40 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:00:40 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:00:40 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEKlHp-ffB5qpjCBg3_yj5xaQGXUXfXR_5nBG6ez1-HwtrD3_1MxdsBq9GDWJG0Nb7rOLD7or8imZj1B1p4iycCFyBKFDyYdCmHhcZFak7DERLpFC6NyyqFSDqZOaMhMe2sZXP-WXFvbOTflheQDmqByZOOYNfWPHU6yfvM-KuleK0A Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Project-Id: 896d3c28f5394d338751e9760b2bf797 Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Project-Name: tempest-VolumesNegativeTest-1324976558 Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/896d3c28f5394d338751e9760b2bf797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/896d3c28f5394d338751e9760b2bf797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/896d3c28f5394d338751e9760b2bf797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Tenant: tempest-VolumesNegativeTest-1324976558 Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Tenant-Id: 896d3c28f5394d338751e9760b2bf797 Apr 13 18:00:40 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-VolumesNegativeTest-1324976558 Apr 13 18:00:40 user devstack@n-api.service[61676]: X-User: tempest-VolumesNegativeTest-1324976558-project-member Apr 13 18:00:40 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:00:40 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:00:40 user devstack@n-api.service[61676]: X-User-Id: c7a49ea3332547cbb44e26d070ac91b6 Apr 13 18:00:40 user devstack@n-api.service[61676]: X-User-Name: tempest-VolumesNegativeTest-1324976558-project-member Apr 13 18:00:40 user devstack@n-api.service[61676]: method: > Apr 13 18:00:40 user devstack@n-api.service[61676]: exception: Instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 could not be found. Apr 13 18:00:40 user devstack@n-api.service[61676]: action_args: {'id': '75eb1a09-48f8-4689-bd5e-9234ec6ac2f8'} Apr 13 18:00:40 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 could not be found. Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 could not be found. Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 could not be found. Apr 13 18:00:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:00:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Returning 404 to user: Instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:00:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-5027b815-b1de-425c-a704-63b6ac5b7790 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" status: 404 len: 111 microversion: 2.1 time: 0.032027 Apr 13 18:00:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 246/726] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:40 2023] GET /compute/v2.1/servers/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:41 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'flavor' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:00:41 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/action" status: 200 len: 32 microversion: 2.1 time: 0.186565 Apr 13 18:00:41 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 243/727] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 18:00:41 2023] POST /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:00:41 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:00:41 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:00:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:42 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:00:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-3d52b442-1d54-419c-b84e-70a0d54a380a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374" status: 200 len: 1724 microversion: 2.1 time: 0.349671 Apr 13 18:00:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 239/728] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:00:41 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:00:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-unplugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] Creating event network-vif-unplugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:00:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068649 Apr 13 18:00:42 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 247/729] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:44 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-plugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] Creating event network-vif-plugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:00:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059080 Apr 13 18:00:44 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 244/730] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:00:46 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-plugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}, {"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-plugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:00:46 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=23 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:00:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:00:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:00:46 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=39 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:00:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Creating event network-vif-plugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:00:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Creating event network-vif-plugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:00:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034371 Apr 13 18:00:46 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 240/731] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:00:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:01:03 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 HTTP/1.1 Apr 13 18:01:03 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:01:03 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:01:03 user devstack@n-api.service[61676]: Connection: close Apr 13 18:01:03 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:01:03 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:01:03 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:01:03 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:01:03 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:01:03 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:01:03 user devstack@n-api.service[61676]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:01:03 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:01:03 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:01:03 user devstack@n-api.service[61676]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:01:03 user devstack@n-api.service[61676]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:01:03 user devstack@n-api.service[61676]: method: > Apr 13 18:01:03 user devstack@n-api.service[61676]: exception: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61676]: action_args: {'id': 'a594110c-a772-408d-8650-b5f2ab1e5f56'} Apr 13 18:01:03 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:01:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-3840a370-b871-4240-a2eb-8105a0a94212 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56" status: 404 len: 111 microversion: 2.1 time: 0.032095 Apr 13 18:01:03 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 248/732] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:01:03 2023] GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=3 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:01:03 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 HTTP/1.1 Apr 13 18:01:03 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:01:03 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:01:03 user devstack@n-api.service[61677]: Connection: close Apr 13 18:01:03 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:01:03 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:01:03 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:01:03 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:01:03 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:01:03 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:01:03 user devstack@n-api.service[61677]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:01:03 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:01:03 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:01:03 user devstack@n-api.service[61677]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:01:03 user devstack@n-api.service[61677]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:01:03 user devstack@n-api.service[61677]: method: > Apr 13 18:01:03 user devstack@n-api.service[61677]: exception: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61677]: action_args: {'id': 'a594110c-a772-408d-8650-b5f2ab1e5f56'} Apr 13 18:01:03 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:01:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-077f28e9-e708-45ab-b89b-0a872b3d57c6 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56" status: 404 len: 111 microversion: 2.1 time: 0.036020 Apr 13 18:01:03 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 245/733] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:01:03 2023] DELETE /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:01:03 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 HTTP/1.1 Apr 13 18:01:03 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:01:03 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:01:03 user devstack@n-api.service[61678]: Connection: close Apr 13 18:01:03 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:01:03 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:01:03 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:01:03 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:01:03 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:01:03 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:01:03 user devstack@n-api.service[61678]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:01:03 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:01:03 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:01:03 user devstack@n-api.service[61678]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:01:03 user devstack@n-api.service[61678]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:01:03 user devstack@n-api.service[61678]: method: > Apr 13 18:01:03 user devstack@n-api.service[61678]: exception: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61678]: action_args: {'id': 'a594110c-a772-408d-8650-b5f2ab1e5f56'} Apr 13 18:01:03 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. Apr 13 18:01:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:01:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:01:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7791d113-ae98-4fcc-a3e8-43393a1439b4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56" status: 404 len: 111 microversion: 2.1 time: 0.039197 Apr 13 18:01:03 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 241/734] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:01:03 2023] GET /compute/v2.1/servers/a594110c-a772-408d-8650-b5f2ab1e5f56 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:01:09 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-69401224", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "destination_type": "volume"}], "networks": [{"uuid": "8d9da666-0149-44ad-8f19-8f10afceca63"}]}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:09 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] validate_networks() for [('8d9da666-0149-44ad-8f19-8f10afceca63', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting quotas for project d533287b8269447aab81fa7d1312d3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting quotas for user ec5fc9c7b7234904ba39d403764420b3 and project d533287b8269447aab81fa7d1312d3f1. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:01:10 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:01:10 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.783741 Apr 13 18:01:10 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 249/735] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 18:01:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 18:01:10 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f785d908-7889-4401-bf74-9e441ce11bda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:10 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-f785d908-7889-4401-bf74-9e441ce11bda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:10 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-f785d908-7889-4401-bf74-9e441ce11bda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:10 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-f785d908-7889-4401-bf74-9e441ce11bda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:10 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-f785d908-7889-4401-bf74-9e441ce11bda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:10 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f785d908-7889-4401-bf74-9e441ce11bda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74" status: 200 len: 1393 microversion: 2.87 time: 0.076289 Apr 13 18:01:10 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 246/736] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:01:10 2023] GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 => generated 1393 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:01:10 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1216519227", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "2afce609-7ea7-4958-a9dd-326c20de27a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d901aa48-1af6-4ded-9c70-e270315524cc"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:10 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] validate_networks() for [('d901aa48-1af6-4ded-9c70-e270315524cc', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for user 1cd4d2b21dda452dab66c1973c3beec1 and project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:01:11 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2afce609-7ea7-4958-a9dd-326c20de27a0',volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:01:11 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:11 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.708594 Apr 13 18:01:11 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 242/737] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:01:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:01:11 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-57b161f3-2915-4c32-b238-2a6a5ce88e55 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:11 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-57b161f3-2915-4c32-b238-2a6a5ce88e55 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:11 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-57b161f3-2915-4c32-b238-2a6a5ce88e55 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-57b161f3-2915-4c32-b238-2a6a5ce88e55 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd" status: 200 len: 1066 microversion: 2.1 time: 0.079214 Apr 13 18:01:11 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 247/738] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:01:11 2023] GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd => generated 1066 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:01:11 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1763ae1d-0256-4e5f-a395-afe404576d42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4" status: 200 len: 1540 microversion: 2.1 time: 0.172704 Apr 13 18:01:11 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 250/739] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:01:11 2023] GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4 => generated 1540 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:01:13 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] Creating event network-changed:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:01:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037848 Apr 13 18:01:13 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 243/740] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-60272a8c-2867-4f09-8217-2e3e18e19a19 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:15 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-60272a8c-2867-4f09-8217-2e3e18e19a19 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:15 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60272a8c-2867-4f09-8217-2e3e18e19a19 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60272a8c-2867-4f09-8217-2e3e18e19a19 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60272a8c-2867-4f09-8217-2e3e18e19a19 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60272a8c-2867-4f09-8217-2e3e18e19a19 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60272a8c-2867-4f09-8217-2e3e18e19a19 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-60272a8c-2867-4f09-8217-2e3e18e19a19 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:15 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-60272a8c-2867-4f09-8217-2e3e18e19a19 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101053 Apr 13 18:01:15 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 248/741] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:01:15 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-interface => generated 282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:01:15 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b35e0e9b-3b18-4ef8-8299-bff7643aaccd", "tag": "780a9174-8b86-4c52-a264-92a4224ba2a3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] Creating event network-changed:780a9174-8b86-4c52-a264-92a4224ba2a3 for instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd on user Apr 13 18:01:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030444 Apr 13 18:01:15 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 251/742] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:16 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3137ec3f-cb47-4ec9-8321-c6a2486633e1", "tag": "d86c3ad7-5ef2-4356-9a80-5bcf35099658"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:16 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] Creating event network-changed:d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 on user Apr 13 18:01:16 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031445 Apr 13 18:01:16 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 244/743] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-d2797067-01b9-495a-9fb5-14f3e2b545db tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:16 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-d2797067-01b9-495a-9fb5-14f3e2b545db tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d2797067-01b9-495a-9fb5-14f3e2b545db tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d2797067-01b9-495a-9fb5-14f3e2b545db tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d2797067-01b9-495a-9fb5-14f3e2b545db tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d2797067-01b9-495a-9fb5-14f3e2b545db tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d2797067-01b9-495a-9fb5-14f3e2b545db tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d2797067-01b9-495a-9fb5-14f3e2b545db tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-d2797067-01b9-495a-9fb5-14f3e2b545db tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/ips" status: 200 len: 104 microversion: 2.1 time: 0.044083 Apr 13 18:01:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 249/744] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 18:01:16 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/ips => generated 104 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:18 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b799019-1d16-431b-aba7-8111109ad67d"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:18 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297799 Apr 13 18:01:18 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 252/745] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:01:18 2023] POST /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:20 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35e0e9b-3b18-4ef8-8299-bff7643aaccd", "name": "network-vif-plugged", "status": "completed", "tag": "780a9174-8b86-4c52-a264-92a4224ba2a3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:20 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] Creating event network-vif-plugged:780a9174-8b86-4c52-a264-92a4224ba2a3 for instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd on user Apr 13 18:01:20 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053878 Apr 13 18:01:20 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 245/746] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:01:22 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35e0e9b-3b18-4ef8-8299-bff7643aaccd", "name": "network-vif-plugged", "status": "completed", "tag": "780a9174-8b86-4c52-a264-92a4224ba2a3"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:22 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:22 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] Creating event network-vif-plugged:780a9174-8b86-4c52-a264-92a4224ba2a3 for instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd on user Apr 13 18:01:22 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043139 Apr 13 18:01:22 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 250/747] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c88f4c3f-805e-4de3-885a-609b373c3765 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c88f4c3f-805e-4de3-885a-609b373c3765 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c88f4c3f-805e-4de3-885a-609b373c3765 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c88f4c3f-805e-4de3-885a-609b373c3765 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c88f4c3f-805e-4de3-885a-609b373c3765 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c88f4c3f-805e-4de3-885a-609b373c3765 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c88f4c3f-805e-4de3-885a-609b373c3765 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c88f4c3f-805e-4de3-885a-609b373c3765 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c88f4c3f-805e-4de3-885a-609b373c3765 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053304 Apr 13 18:01:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 253/748] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:01:24 2023] GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-plugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] Creating event network-vif-plugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:01:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046831 Apr 13 18:01:25 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 246/749] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:25 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:25 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:01:25 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d7146a-14c1-4dc2-9e98-d1f05bbf3712", "tag": "a494221d-1460-48b2-9a60-b2329efbf6bc"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:25 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] Creating event network-changed:a494221d-1460-48b2-9a60-b2329efbf6bc for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 on user Apr 13 18:01:25 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214950 Apr 13 18:01:25 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 254/750] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712" status: 204 len: 0 microversion: 2.1 time: 0.268837 Apr 13 18:01:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 251/751] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:01:25 2023] DELETE /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:25 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-3d0b53b6-d9d1-4aba-8b44-074c7fc66a83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712" status: 200 len: 1661 microversion: 2.1 time: 0.279878 Apr 13 18:01:25 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 247/752] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:01:25 2023] GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => generated 1661 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:01:26 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-cec333c8-619a-4069-a496-1e9d7e009182 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:26 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-cec333c8-619a-4069-a496-1e9d7e009182 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cec333c8-619a-4069-a496-1e9d7e009182 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cec333c8-619a-4069-a496-1e9d7e009182 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cec333c8-619a-4069-a496-1e9d7e009182 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cec333c8-619a-4069-a496-1e9d7e009182 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cec333c8-619a-4069-a496-1e9d7e009182 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-cec333c8-619a-4069-a496-1e9d7e009182 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-cec333c8-619a-4069-a496-1e9d7e009182 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049677 Apr 13 18:01:26 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 255/753] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:01:26 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:26 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3a44651f-cf2b-497d-8746-5c471b72a747 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:26 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3a44651f-cf2b-497d-8746-5c471b72a747 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3a44651f-cf2b-497d-8746-5c471b72a747 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3a44651f-cf2b-497d-8746-5c471b72a747 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3a44651f-cf2b-497d-8746-5c471b72a747 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3a44651f-cf2b-497d-8746-5c471b72a747 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3a44651f-cf2b-497d-8746-5c471b72a747 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3a44651f-cf2b-497d-8746-5c471b72a747 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:26 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3a44651f-cf2b-497d-8746-5c471b72a747 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/3b799019-1d16-431b-aba7-8111109ad67d" status: 200 len: 194 microversion: 2.1 time: 0.063151 Apr 13 18:01:26 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 252/754] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 18:01:26 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/3b799019-1d16-431b-aba7-8111109ad67d => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ee2aec09-c446-47b5-ae3f-cdb6a173fd81 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "299af28a-7e3d-47eb-830b-4ac3e6534ed8"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:26 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ee2aec09-c446-47b5-ae3f-cdb6a173fd81 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee2aec09-c446-47b5-ae3f-cdb6a173fd81 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee2aec09-c446-47b5-ae3f-cdb6a173fd81 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee2aec09-c446-47b5-ae3f-cdb6a173fd81 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee2aec09-c446-47b5-ae3f-cdb6a173fd81 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee2aec09-c446-47b5-ae3f-cdb6a173fd81 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ee2aec09-c446-47b5-ae3f-cdb6a173fd81 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ee2aec09-c446-47b5-ae3f-cdb6a173fd81 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.561049 Apr 13 18:01:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 248/755] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 18:01:26 2023] POST /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/os-volume_attachments => generated 188 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-plugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}, {"server_uuid": "34d7146a-14c1-4dc2-9e98-d1f05bbf3712", "name": "network-vif-unplugged", "status": "completed", "tag": "a494221d-1460-48b2-9a60-b2329efbf6bc"}, {"server_uuid": "34d7146a-14c1-4dc2-9e98-d1f05bbf3712", "name": "network-vif-plugged", "status": "completed", "tag": "a494221d-1460-48b2-9a60-b2329efbf6bc"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-db954676-f395-4005-9ef9-ed8db29380d3 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-db954676-f395-4005-9ef9-ed8db29380d3 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-db954676-f395-4005-9ef9-ed8db29380d3 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-db954676-f395-4005-9ef9-ed8db29380d3 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-db954676-f395-4005-9ef9-ed8db29380d3 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-db954676-f395-4005-9ef9-ed8db29380d3 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-db954676-f395-4005-9ef9-ed8db29380d3 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-db954676-f395-4005-9ef9-ed8db29380d3 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Creating event network-vif-plugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:01:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Creating event network-vif-unplugged:a494221d-1460-48b2-9a60-b2329efbf6bc for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 on user Apr 13 18:01:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Creating event network-vif-plugged:a494221d-1460-48b2-9a60-b2329efbf6bc for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 on user Apr 13 18:01:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.064749 Apr 13 18:01:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 256/756] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-db954676-f395-4005-9ef9-ed8db29380d3 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/os-volume_attachments/299af28a-7e3d-47eb-830b-4ac3e6534ed8" status: 202 len: 0 microversion: 2.20 time: 0.290816 Apr 13 18:01:27 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 253/757] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 18:01:27 2023] DELETE /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/os-volume_attachments/299af28a-7e3d-47eb-830b-4ac3e6534ed8 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-c64dd431-5ff4-4ab9-b40b-02bad0032163 req-547e70ab-7b6c-4bae-9d0c-57c70187b101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d7146a-14c1-4dc2-9e98-d1f05bbf3712", "name": "network-vif-deleted", "tag": "a494221d-1460-48b2-9a60-b2329efbf6bc"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c64dd431-5ff4-4ab9-b40b-02bad0032163 req-547e70ab-7b6c-4bae-9d0c-57c70187b101 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c64dd431-5ff4-4ab9-b40b-02bad0032163 req-547e70ab-7b6c-4bae-9d0c-57c70187b101 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c64dd431-5ff4-4ab9-b40b-02bad0032163 req-547e70ab-7b6c-4bae-9d0c-57c70187b101 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c64dd431-5ff4-4ab9-b40b-02bad0032163 req-547e70ab-7b6c-4bae-9d0c-57c70187b101 service nova] Creating event network-vif-deleted:a494221d-1460-48b2-9a60-b2329efbf6bc for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 on user Apr 13 18:01:27 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-c64dd431-5ff4-4ab9-b40b-02bad0032163 req-547e70ab-7b6c-4bae-9d0c-57c70187b101 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028116 Apr 13 18:01:27 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 249/758] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61676) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfc28083-a7da-4e54-9795-3fdf61c34eca"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/action" status: 202 len: 0 microversion: 2.20 time: 0.188011 Apr 13 18:01:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 257/759] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 18:01:27 2023] POST /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:27 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:27 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5a84316f-28b0-4b72-a8d5-3a801c66821b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 200 len: 1659 microversion: 2.20 time: 0.201372 Apr 13 18:01:27 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 250/760] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:01:27 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 1659 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:01:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326953 Apr 13 18:01:27 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 254/761] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:01:27 2023] POST /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] Creating event network-changed:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 18:01:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039390 Apr 13 18:01:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 258/762] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:32 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:32 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:32 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:33 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-e8ba6a88-4f00-4bce-ba4e-0135a1a8a739 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374" status: 200 len: 1704 microversion: 2.1 time: 1.043160 Apr 13 18:01:33 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 251/763] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:01:32 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => generated 1704 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:01:36 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f72bf254-a095-468e-afed-33bfbfd429d7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:36 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-f72bf254-a095-468e-afed-33bfbfd429d7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:36 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f72bf254-a095-468e-afed-33bfbfd429d7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f72bf254-a095-468e-afed-33bfbfd429d7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f72bf254-a095-468e-afed-33bfbfd429d7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f72bf254-a095-468e-afed-33bfbfd429d7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f72bf254-a095-468e-afed-33bfbfd429d7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f72bf254-a095-468e-afed-33bfbfd429d7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:36 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f72bf254-a095-468e-afed-33bfbfd429d7 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.067480 Apr 13 18:01:36 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 255/764] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:01:36 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f3aadcde-30e1-4cbe-915c-f038692b2a72 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f3aadcde-30e1-4cbe-915c-f038692b2a72 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f3aadcde-30e1-4cbe-915c-f038692b2a72 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f3aadcde-30e1-4cbe-915c-f038692b2a72 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f3aadcde-30e1-4cbe-915c-f038692b2a72 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f3aadcde-30e1-4cbe-915c-f038692b2a72 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f3aadcde-30e1-4cbe-915c-f038692b2a72 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f3aadcde-30e1-4cbe-915c-f038692b2a72 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:37 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:37 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f3aadcde-30e1-4cbe-915c-f038692b2a72 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/3b799019-1d16-431b-aba7-8111109ad67d" status: 200 len: 194 microversion: 2.1 time: 0.048998 Apr 13 18:01:37 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 259/765] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 18:01:37 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/3b799019-1d16-431b-aba7-8111109ad67d => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:01:37 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'services' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:01:37 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/3b799019-1d16-431b-aba7-8111109ad67d" status: 202 len: 0 microversion: 2.1 time: 0.178846 Apr 13 18:01:37 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 252/766] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:01:37 2023] DELETE /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/3b799019-1d16-431b-aba7-8111109ad67d => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:01:39 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "name": "network-vif-plugged", "status": "completed", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] Creating event network-vif-plugged:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 18:01:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072152 Apr 13 18:01:39 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 256/767] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:39 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-56802664-7247-4896-bb84-5d32c60b062b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:39 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-56802664-7247-4896-bb84-5d32c60b062b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-56802664-7247-4896-bb84-5d32c60b062b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-56802664-7247-4896-bb84-5d32c60b062b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-56802664-7247-4896-bb84-5d32c60b062b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-56802664-7247-4896-bb84-5d32c60b062b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-56802664-7247-4896-bb84-5d32c60b062b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-56802664-7247-4896-bb84-5d32c60b062b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:39 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-56802664-7247-4896-bb84-5d32c60b062b tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/bfc28083-a7da-4e54-9795-3fdf61c34eca" status: 200 len: 194 microversion: 2.1 time: 0.043949 Apr 13 18:01:39 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 260/768] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 18:01:39 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/bfc28083-a7da-4e54-9795-3fdf61c34eca => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:39 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:39 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:39 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'services' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:01:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/bfc28083-a7da-4e54-9795-3fdf61c34eca" status: 202 len: 0 microversion: 2.1 time: 0.188843 Apr 13 18:01:39 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 253/769] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:01:39 2023] DELETE /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments/bfc28083-a7da-4e54-9795-3fdf61c34eca => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:01:41 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "name": "network-vif-plugged", "status": "completed", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:41 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] Creating event network-vif-plugged:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 18:01:41 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029611 Apr 13 18:01:41 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 257/770] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-82edf8b9-b0d2-4a74-ab60-df49620c2740 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-82edf8b9-b0d2-4a74-ab60-df49620c2740 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-82edf8b9-b0d2-4a74-ab60-df49620c2740 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-82edf8b9-b0d2-4a74-ab60-df49620c2740 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-82edf8b9-b0d2-4a74-ab60-df49620c2740 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-82edf8b9-b0d2-4a74-ab60-df49620c2740 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-82edf8b9-b0d2-4a74-ab60-df49620c2740 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-82edf8b9-b0d2-4a74-ab60-df49620c2740 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-82edf8b9-b0d2-4a74-ab60-df49620c2740 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044740 Apr 13 18:01:42 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 261/771] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:01:42 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:01:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0973f3f1-b6b4-4ca5-929a-4394c0647089 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:42 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0973f3f1-b6b4-4ca5-929a-4394c0647089 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0973f3f1-b6b4-4ca5-929a-4394c0647089 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0973f3f1-b6b4-4ca5-929a-4394c0647089 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0973f3f1-b6b4-4ca5-929a-4394c0647089 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0973f3f1-b6b4-4ca5-929a-4394c0647089 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0973f3f1-b6b4-4ca5-929a-4394c0647089 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0973f3f1-b6b4-4ca5-929a-4394c0647089 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0973f3f1-b6b4-4ca5-929a-4394c0647089 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053482 Apr 13 18:01:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 254/772] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:01:42 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:01:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:42 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:42 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:01:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1" status: 204 len: 0 microversion: 2.1 time: 0.124948 Apr 13 18:01:42 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 258/773] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:01:42 2023] DELETE /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:42 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:01:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c42d51fb-68a2-4ba8-ac91-46b6784a846a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1" status: 200 len: 1663 microversion: 2.1 time: 0.219260 Apr 13 18:01:42 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 262/774] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:01:42 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 => generated 1663 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:01:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3137ec3f-cb47-4ec9-8321-c6a2486633e1", "name": "network-vif-unplugged", "status": "completed", "tag": "d86c3ad7-5ef2-4356-9a80-5bcf35099658"}, {"server_uuid": "3137ec3f-cb47-4ec9-8321-c6a2486633e1", "name": "network-vif-plugged", "status": "completed", "tag": "d86c3ad7-5ef2-4356-9a80-5bcf35099658"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Creating event network-vif-unplugged:d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 on user Apr 13 18:01:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Creating event network-vif-plugged:d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 on user Apr 13 18:01:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033711 Apr 13 18:01:43 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 255/775] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:43 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:01:44 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-3f72c395-f057-4380-be9c-4c719b00fa16 req-8a2102fc-6b5b-4e90-8d4f-4a0b84367833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3137ec3f-cb47-4ec9-8321-c6a2486633e1", "name": "network-vif-deleted", "tag": "d86c3ad7-5ef2-4356-9a80-5bcf35099658"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:01:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-3f72c395-f057-4380-be9c-4c719b00fa16 req-8a2102fc-6b5b-4e90-8d4f-4a0b84367833 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:01:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-3f72c395-f057-4380-be9c-4c719b00fa16 req-8a2102fc-6b5b-4e90-8d4f-4a0b84367833 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:01:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-3f72c395-f057-4380-be9c-4c719b00fa16 req-8a2102fc-6b5b-4e90-8d4f-4a0b84367833 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:01:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-3f72c395-f057-4380-be9c-4c719b00fa16 req-8a2102fc-6b5b-4e90-8d4f-4a0b84367833 service nova] Creating event network-vif-deleted:d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 on user Apr 13 18:01:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-3f72c395-f057-4380-be9c-4c719b00fa16 req-8a2102fc-6b5b-4e90-8d4f-4a0b84367833 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045790 Apr 13 18:01:44 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 259/776] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:01:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=7 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=23 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:00 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:00 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ad73908d-e7b1-4139-9099-ecf9d07cc207 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74" status: 200 len: 1766 microversion: 2.87 time: 0.203126 Apr 13 18:02:00 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 263/777] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:02:00 2023] GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 => generated 1766 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=7 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:01 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:01 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-bcfb4b24-5ed6-481d-920b-d9ebaf74c71c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd" status: 200 len: 1393 microversion: 2.1 time: 0.151249 Apr 13 18:02:01 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 256/778] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:02:01 2023] GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=10,nova_cell1:INSERT=5 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-58c474f7-47c7-4fe5-9723-ebbf090217e9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-58c474f7-47c7-4fe5-9723-ebbf090217e9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-58c474f7-47c7-4fe5-9723-ebbf090217e9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-58c474f7-47c7-4fe5-9723-ebbf090217e9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-58c474f7-47c7-4fe5-9723-ebbf090217e9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-58c474f7-47c7-4fe5-9723-ebbf090217e9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-58c474f7-47c7-4fe5-9723-ebbf090217e9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-58c474f7-47c7-4fe5-9723-ebbf090217e9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-58c474f7-47c7-4fe5-9723-ebbf090217e9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.233772 Apr 13 18:02:11 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 260/779] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:02:11 2023] GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4/os-interface => generated 283 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b75d41c6-6cf6-4162-b49b-c3205c128ef4", "tag": "54109c72-9d87-44b7-a358-864c31b9c96d"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:12 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:12 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] Creating event network-changed:54109c72-9d87-44b7-a358-864c31b9c96d for instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 on user Apr 13 18:02:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037326 Apr 13 18:02:12 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 264/780] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-567832214", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "10638cc2-22a6-4aac-b79a-2baa9327e1bc"}], "security_groups": [{"name": "tempest-securitygroup--2068620042"}], "key_name": "tempest-keypair-1272899020", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ccc0e336-b49f-4de4-855a-62f15a62f081", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] validate_networks() for [('10638cc2-22a6-4aac-b79a-2baa9327e1bc', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for user 8f796555c0e242d091502725ec595c0f and project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:02:15 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccc0e336-b49f-4de4-855a-62f15a62f081',volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:02:15 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] HTTP exception thrown: Instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 could not be found. Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Request method failure captured: Apr 13 18:02:15 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712 HTTP/1.1 Apr 13 18:02:15 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:02:15 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:02:15 user devstack@n-api.service[61677]: Connection: close Apr 13 18:02:15 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:02:15 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:02:15 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:02:15 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:02:15 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEIBAuoTab9vlzLMJngLumB0Umh2fG1Zc1jm4_BVkgSmwQbLr5l9wa6O-xYWsRlUyTICGZ3mMsqkDuqCsPzx-tJN8S_peS14iTL76nFgroteP43mfuxa6MXgr0TECqfRzFbE5q31fXaviNr027spO9llW02pYIi9L3bu0AFXMBQMby4 Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Project-Id: 433b58054cc942efad3646ebf4ff286e Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestStampPattern-1307048889 Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/433b58054cc942efad3646ebf4ff286e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/433b58054cc942efad3646ebf4ff286e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/433b58054cc942efad3646ebf4ff286e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Tenant: tempest-TestStampPattern-1307048889 Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Tenant-Id: 433b58054cc942efad3646ebf4ff286e Apr 13 18:02:15 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestStampPattern-1307048889 Apr 13 18:02:15 user devstack@n-api.service[61677]: X-User: tempest-TestStampPattern-1307048889-project-member Apr 13 18:02:15 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:02:15 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:02:15 user devstack@n-api.service[61677]: X-User-Id: 2b565bc35a4742808d360a395858134b Apr 13 18:02:15 user devstack@n-api.service[61677]: X-User-Name: tempest-TestStampPattern-1307048889-project-member Apr 13 18:02:15 user devstack@n-api.service[61677]: method: > Apr 13 18:02:15 user devstack@n-api.service[61677]: exception: Instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 could not be found. Apr 13 18:02:15 user devstack@n-api.service[61677]: action_args: {'id': '34d7146a-14c1-4dc2-9e98-d1f05bbf3712'} Apr 13 18:02:15 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 could not be found. Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 could not be found. Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 could not be found. Apr 13 18:02:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Returning 404 to user: Instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:02:15 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1ee04939-203c-4b19-9c33-effe5bb44c31 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712" status: 404 len: 111 microversion: 2.1 time: 0.072351 Apr 13 18:02:15 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 261/781] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:02:15 2023] GET /compute/v2.1/servers/34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:02:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.689901 Apr 13 18:02:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 257/782] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:02:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:02:16 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e2ed4fd6-73cc-4c1e-b00e-4aaff1649536 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:16 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-e2ed4fd6-73cc-4c1e-b00e-4aaff1649536 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:16 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-e2ed4fd6-73cc-4c1e-b00e-4aaff1649536 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:16 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-e2ed4fd6-73cc-4c1e-b00e-4aaff1649536 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 200 len: 1075 microversion: 2.1 time: 0.072875 Apr 13 18:02:16 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 265/783] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:02:15 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 1075 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:02:17 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:17 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:17 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:17 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:17 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:17 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:17 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:17 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:18 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:18 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:18 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:18 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8f65d9ea-b9ce-4d67-8b1e-49645e056666 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 200 len: 1704 microversion: 2.20 time: 0.240428 Apr 13 18:02:18 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 262/784] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:02:17 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 1704 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:02:18 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] Creating event network-changed:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:02:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042773 Apr 13 18:02:18 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 258/785] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:20 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] HTTP exception thrown: Instance 9851b648-0b93-441b-9912-2216b528d030 is not attached to volume 2e5aab40-4eb4-44b3-a738-4f230bae10b3 Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Request method failure captured: Apr 13 18:02:20 user devstack@n-api.service[61676]: request: DELETE /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments/2e5aab40-4eb4-44b3-a738-4f230bae10b3 HTTP/1.1 Apr 13 18:02:20 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:02:20 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:02:20 user devstack@n-api.service[61676]: Connection: close Apr 13 18:02:20 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:02:20 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:02:20 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:02:20 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:02:20 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEIBAuoTab9vlzLMJngLumB0Umh2fG1Zc1jm4_BVkgSmwQbLr5l9wa6O-xYWsRlUyTICGZ3mMsqkDuqCsPzx-tJN8S_peS14iTL76nFgroteP43mfuxa6MXgr0TECqfRzFbE5q31fXaviNr027spO9llW02pYIi9L3bu0AFXMBQMby4 Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Project-Id: 433b58054cc942efad3646ebf4ff286e Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Project-Name: tempest-TestStampPattern-1307048889 Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/433b58054cc942efad3646ebf4ff286e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/433b58054cc942efad3646ebf4ff286e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/433b58054cc942efad3646ebf4ff286e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Tenant: tempest-TestStampPattern-1307048889 Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Tenant-Id: 433b58054cc942efad3646ebf4ff286e Apr 13 18:02:20 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-TestStampPattern-1307048889 Apr 13 18:02:20 user devstack@n-api.service[61676]: X-User: tempest-TestStampPattern-1307048889-project-member Apr 13 18:02:20 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:02:20 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:02:20 user devstack@n-api.service[61676]: X-User-Id: 2b565bc35a4742808d360a395858134b Apr 13 18:02:20 user devstack@n-api.service[61676]: X-User-Name: tempest-TestStampPattern-1307048889-project-member Apr 13 18:02:20 user devstack@n-api.service[61676]: method: > Apr 13 18:02:20 user devstack@n-api.service[61676]: exception: Instance 9851b648-0b93-441b-9912-2216b528d030 is not attached to volume 2e5aab40-4eb4-44b3-a738-4f230bae10b3 Apr 13 18:02:20 user devstack@n-api.service[61676]: action_args: {'server_id': '9851b648-0b93-441b-9912-2216b528d030', 'id': '2e5aab40-4eb4-44b3-a738-4f230bae10b3'} Apr 13 18:02:20 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2e5aab40-4eb4-44b3-a738-4f230bae10b3. Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9851b648-0b93-441b-9912-2216b528d030 is not attached to volume 2e5aab40-4eb4-44b3-a738-4f230bae10b3 Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9851b648-0b93-441b-9912-2216b528d030 is not attached to volume 2e5aab40-4eb4-44b3-a738-4f230bae10b3 Apr 13 18:02:20 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:20 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Returning 404 to user: Instance 9851b648-0b93-441b-9912-2216b528d030 is not attached to volume 2e5aab40-4eb4-44b3-a738-4f230bae10b3 {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:02:20 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c66fa821-de29-4389-8f84-42951e753d20 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments/2e5aab40-4eb4-44b3-a738-4f230bae10b3" status: 404 len: 154 microversion: 2.1 time: 0.095589 Apr 13 18:02:20 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 266/786] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:02:20 2023] DELETE /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030/os-volume_attachments/2e5aab40-4eb4-44b3-a738-4f230bae10b3 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:02:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:02:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9851b648-0b93-441b-9912-2216b528d030", "tag": "b13328b5-41f1-4f0d-a862-d2e286c0602f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] Creating event network-changed:b13328b5-41f1-4f0d-a862-d2e286c0602f for instance 9851b648-0b93-441b-9912-2216b528d030 on user Apr 13 18:02:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103044 Apr 13 18:02:21 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 259/787] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030" status: 204 len: 0 microversion: 2.1 time: 0.148514 Apr 13 18:02:21 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 263/788] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:02:21 2023] DELETE /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:02:21 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:21 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:21 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-b85ac9c0-c0ce-4f32-a346-1e97e488f5f5 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030" status: 200 len: 1661 microversion: 2.1 time: 0.196779 Apr 13 18:02:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 267/789] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:02:21 2023] GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030 => generated 1661 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:02:22 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9851b648-0b93-441b-9912-2216b528d030", "name": "network-vif-unplugged", "status": "completed", "tag": "b13328b5-41f1-4f0d-a862-d2e286c0602f"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] Creating event network-vif-unplugged:b13328b5-41f1-4f0d-a862-d2e286c0602f for instance 9851b648-0b93-441b-9912-2216b528d030 on user Apr 13 18:02:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030423 Apr 13 18:02:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 260/790] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:23 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9851b648-0b93-441b-9912-2216b528d030", "name": "network-vif-deleted", "tag": "b13328b5-41f1-4f0d-a862-d2e286c0602f"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] Creating event network-vif-deleted:b13328b5-41f1-4f0d-a862-d2e286c0602f for instance 9851b648-0b93-441b-9912-2216b528d030 on user Apr 13 18:02:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033461 Apr 13 18:02:23 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 264/791] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9851b648-0b93-441b-9912-2216b528d030", "name": "network-vif-plugged", "status": "completed", "tag": "b13328b5-41f1-4f0d-a862-d2e286c0602f"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] Creating event network-vif-plugged:b13328b5-41f1-4f0d-a862-d2e286c0602f for instance 9851b648-0b93-441b-9912-2216b528d030 on user Apr 13 18:02:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032833 Apr 13 18:02:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 268/792] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:24 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "name": "network-vif-plugged", "status": "completed", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:24 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] Creating event network-vif-plugged:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:02:24 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028863 Apr 13 18:02:24 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 261/793] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:26 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "name": "network-vif-plugged", "status": "completed", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:26 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] Creating event network-vif-plugged:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:02:26 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066431 Apr 13 18:02:26 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 265/794] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HTTP exception thrown: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Request method failure captured: Apr 13 18:02:32 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 HTTP/1.1 Apr 13 18:02:32 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:02:32 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:02:32 user devstack@n-api.service[61676]: Connection: close Apr 13 18:02:32 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:02:32 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:02:32 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:02:32 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:02:32 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOECNjxnA2Xl2crGLWMHF48XkKEhzAWqqun6kWJY-bYak5b7nj1LPmhgt6asPvC8BrmVMxxB9-5IoXNCqHea27biR0vgDC6Kgnwy8FBTjmy_mrBHmGkgcKZm20QrOv-P4WyJS3piwkZQ1RMJcfC4LINKcdRnRcU-NIoxYeXdoDfUp3Fg Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Project-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Project-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Tenant: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Tenant-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:32 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:32 user devstack@n-api.service[61676]: X-User: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:32 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:02:32 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:02:32 user devstack@n-api.service[61676]: X-User-Id: 91769944ac8048dbb1f418d232e670d3 Apr 13 18:02:32 user devstack@n-api.service[61676]: X-User-Name: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:32 user devstack@n-api.service[61676]: method: > Apr 13 18:02:32 user devstack@n-api.service[61676]: exception: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:32 user devstack@n-api.service[61676]: action_args: {'id': '3137ec3f-cb47-4ec9-8321-c6a2486633e1'} Apr 13 18:02:32 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:32 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:32 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Returning 404 to user: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:02:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-20c6ef33-3fb0-4ccb-8509-a5cd4d59fa89 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1" status: 404 len: 111 microversion: 2.1 time: 0.045064 Apr 13 18:02:32 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 269/795] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:02:32 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:02:32 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-e59b09df-d67e-441c-9e38-d610e2565bc2 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '.version_select at 0x7f82e23f83a0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:32 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:32 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-e59b09df-d67e-441c-9e38-d610e2565bc2 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877620197" status: 202 len: 0 microversion: 2.1 time: 0.026979 Apr 13 18:02:32 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 262/796] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 18:02:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877620197 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:33 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] HTTP exception thrown: Cannot 'detach_volume' instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 while it is in vm_state rescued Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Request method failure captured: Apr 13 18:02:33 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments/c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b HTTP/1.1 Apr 13 18:02:33 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:02:33 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:02:33 user devstack@n-api.service[61677]: Connection: close Apr 13 18:02:33 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:02:33 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:02:33 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:02:33 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:02:33 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEDQnq4eQIZsnZOBn_j0_FU-f6LzfH5sy33GgC-hZqDIpXlV9V16O3ymT_4_jNnW8zh3Wer2j7e-5Vd1U0kX2BDIXPghI3-OHKVTmGKeSIMWv8bHIM3PWyuZyexyDKi3Zc4I686nabAZRhg5TYwZuKE4MHrKq5Bakp5f8QPHOtRfXWo Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Project-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Tenant: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Tenant-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 18:02:33 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:02:33 user devstack@n-api.service[61677]: X-User: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 18:02:33 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:02:33 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:02:33 user devstack@n-api.service[61677]: X-User-Id: 8f1fe2e6fd894d5c87d7ccf5fae553ca Apr 13 18:02:33 user devstack@n-api.service[61677]: X-User-Name: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 18:02:33 user devstack@n-api.service[61677]: method: > Apr 13 18:02:33 user devstack@n-api.service[61677]: exception: Cannot 'detach_volume' instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 while it is in vm_state rescued Apr 13 18:02:33 user devstack@n-api.service[61677]: action_args: {'server_id': 'dd2b2a73-ff8a-4357-bad3-6be8fd95b374', 'id': 'c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b'} Apr 13 18:02:33 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 while it is in vm_state rescued Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 while it is in vm_state rescued Apr 13 18:02:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Returning 409 to user: Cannot 'detach_volume' instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 while it is in vm_state rescued {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:02:33 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-0c955b69-50b3-4766-9e2a-efc08d5f236d tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments/c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b" status: 409 len: 152 microversion: 2.1 time: 0.123168 Apr 13 18:02:33 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 266/797] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:02:33 2023] DELETE /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments/c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 18:02:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:33 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/action" status: 202 len: 0 microversion: 2.1 time: 0.072515 Apr 13 18:02:33 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 270/798] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 18:02:33 2023] POST /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:02:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:33 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:33 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:02:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-61666abe-9942-4c77-9970-b11815baac64 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374" status: 200 len: 1712 microversion: 2.1 time: 0.186541 Apr 13 18:02:33 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 263/799] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:02:33 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => generated 1712 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:02:34 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-unplugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] Creating event network-vif-unplugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:02:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041187 Apr 13 18:02:34 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 267/800] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:36 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-plugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}, {"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-plugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:36 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:36 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:36 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:36 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Creating event network-vif-plugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:02:36 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Creating event network-vif-plugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:02:36 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036642 Apr 13 18:02:36 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 271/801] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-plugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:02:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] Creating event network-vif-plugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:02:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037419 Apr 13 18:02:38 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 264/802] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:02:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HTTP exception thrown: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Request method failure captured: Apr 13 18:02:39 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 HTTP/1.1 Apr 13 18:02:39 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:02:39 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:02:39 user devstack@n-api.service[61677]: Connection: close Apr 13 18:02:39 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:02:39 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:02:39 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:02:39 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:02:39 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOECNjxnA2Xl2crGLWMHF48XkKEhzAWqqun6kWJY-bYak5b7nj1LPmhgt6asPvC8BrmVMxxB9-5IoXNCqHea27biR0vgDC6Kgnwy8FBTjmy_mrBHmGkgcKZm20QrOv-P4WyJS3piwkZQ1RMJcfC4LINKcdRnRcU-NIoxYeXdoDfUp3Fg Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Project-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Tenant-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:39 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:39 user devstack@n-api.service[61677]: X-User: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:39 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:02:39 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:02:39 user devstack@n-api.service[61677]: X-User-Id: 91769944ac8048dbb1f418d232e670d3 Apr 13 18:02:39 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:39 user devstack@n-api.service[61677]: method: > Apr 13 18:02:39 user devstack@n-api.service[61677]: exception: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61677]: action_args: {'id': '3137ec3f-cb47-4ec9-8321-c6a2486633e1'} Apr 13 18:02:39 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Returning 404 to user: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:02:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a3efbe53-e0e5-4ca6-8942-08ab733a0247 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1" status: 404 len: 111 microversion: 2.1 time: 0.051977 Apr 13 18:02:39 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 268/803] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:02:39 2023] DELETE /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:39 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HTTP exception thrown: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Request method failure captured: Apr 13 18:02:39 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 HTTP/1.1 Apr 13 18:02:39 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:02:39 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:02:39 user devstack@n-api.service[61676]: Connection: close Apr 13 18:02:39 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:02:39 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:02:39 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:02:39 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:02:39 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOECNjxnA2Xl2crGLWMHF48XkKEhzAWqqun6kWJY-bYak5b7nj1LPmhgt6asPvC8BrmVMxxB9-5IoXNCqHea27biR0vgDC6Kgnwy8FBTjmy_mrBHmGkgcKZm20QrOv-P4WyJS3piwkZQ1RMJcfC4LINKcdRnRcU-NIoxYeXdoDfUp3Fg Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Project-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Project-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Tenant: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Tenant-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:39 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:39 user devstack@n-api.service[61676]: X-User: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:39 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:02:39 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:02:39 user devstack@n-api.service[61676]: X-User-Id: 91769944ac8048dbb1f418d232e670d3 Apr 13 18:02:39 user devstack@n-api.service[61676]: X-User-Name: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:39 user devstack@n-api.service[61676]: method: > Apr 13 18:02:39 user devstack@n-api.service[61676]: exception: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61676]: action_args: {'id': '3137ec3f-cb47-4ec9-8321-c6a2486633e1'} Apr 13 18:02:39 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. Apr 13 18:02:39 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:02:39 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Returning 404 to user: Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:02:39 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f6b4d50b-a7a6-43bb-99cc-0b40b191beaa tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1" status: 404 len: 111 microversion: 2.1 time: 0.043729 Apr 13 18:02:39 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 272/804] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:02:39 2023] GET /compute/v2.1/servers/3137ec3f-cb47-4ec9-8321-c6a2486633e1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HTTP exception thrown: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Request method failure captured: Apr 13 18:02:42 user devstack@n-api.service[61678]: request: DELETE /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 HTTP/1.1 Apr 13 18:02:42 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:02:42 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:02:42 user devstack@n-api.service[61678]: Connection: close Apr 13 18:02:42 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:02:42 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:02:42 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:02:42 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:02:42 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOECNjxnA2Xl2crGLWMHF48XkKEhzAWqqun6kWJY-bYak5b7nj1LPmhgt6asPvC8BrmVMxxB9-5IoXNCqHea27biR0vgDC6Kgnwy8FBTjmy_mrBHmGkgcKZm20QrOv-P4WyJS3piwkZQ1RMJcfC4LINKcdRnRcU-NIoxYeXdoDfUp3Fg Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Project-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Tenant-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:42 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:42 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:42 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:02:42 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:02:42 user devstack@n-api.service[61678]: X-User-Id: 91769944ac8048dbb1f418d232e670d3 Apr 13 18:02:42 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:42 user devstack@n-api.service[61678]: method: > Apr 13 18:02:42 user devstack@n-api.service[61678]: exception: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61678]: action_args: {'id': 'bcfd107b-fef8-4acf-9a2c-1861aabacfe9'} Apr 13 18:02:42 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Returning 404 to user: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:02:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5e6682e4-a8c8-4441-9b62-e8eda22f7cd8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 404 len: 111 microversion: 2.1 time: 0.033138 Apr 13 18:02:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 265/805] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:02:42 2023] DELETE /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:02:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HTTP exception thrown: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Request method failure captured: Apr 13 18:02:42 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 HTTP/1.1 Apr 13 18:02:42 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:02:42 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:02:42 user devstack@n-api.service[61677]: Connection: close Apr 13 18:02:42 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:02:42 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:02:42 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:02:42 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:02:42 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOECNjxnA2Xl2crGLWMHF48XkKEhzAWqqun6kWJY-bYak5b7nj1LPmhgt6asPvC8BrmVMxxB9-5IoXNCqHea27biR0vgDC6Kgnwy8FBTjmy_mrBHmGkgcKZm20QrOv-P4WyJS3piwkZQ1RMJcfC4LINKcdRnRcU-NIoxYeXdoDfUp3Fg Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Project-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ee8ad9e1bc74eb9b9997f7706d3f096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Tenant-Id: 5ee8ad9e1bc74eb9b9997f7706d3f096 Apr 13 18:02:42 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2087525588 Apr 13 18:02:42 user devstack@n-api.service[61677]: X-User: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:42 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:02:42 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:02:42 user devstack@n-api.service[61677]: X-User-Id: 91769944ac8048dbb1f418d232e670d3 Apr 13 18:02:42 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachVolumeTestJSON-2087525588-project-member Apr 13 18:02:42 user devstack@n-api.service[61677]: method: > Apr 13 18:02:42 user devstack@n-api.service[61677]: exception: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61677]: action_args: {'id': 'bcfd107b-fef8-4acf-9a2c-1861aabacfe9'} Apr 13 18:02:42 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. Apr 13 18:02:42 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:02:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Returning 404 to user: Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:02:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2c0ad3c9-1a29-4a48-aa0e-f1fc0d57ac3f tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9" status: 404 len: 111 microversion: 2.1 time: 0.042312 Apr 13 18:02:42 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 269/806] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:02:42 2023] GET /compute/v2.1/servers/bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "70661680-8bf5-47be-98c2-33fd8064aaf6"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=20 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:01 user devstack@n-api.service[61676]: DEBUG nova.objects.instance [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'flavor' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=61676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:03:01 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74/action" status: 200 len: 29 microversion: 2.87 time: 0.576208 Apr 13 18:03:01 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 273/807] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 18:03:01 2023] POST /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74/action => generated 29 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=20 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:01 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:01 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9a8927a6-166c-4f5f-b38c-ae8acac90416 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74" status: 200 len: 1772 microversion: 2.87 time: 0.172402 Apr 13 18:03:01 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 266/808] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:03:01 2023] GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 => generated 1772 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:03:01 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:01 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:01 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:01 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:02 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:02 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-31a88fda-4624-4814-b782-e70ecd120b59 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd" status: 200 len: 1393 microversion: 2.1 time: 0.342208 Apr 13 18:03:02 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 270/809] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:03:01 2023] GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd => generated 1393 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:03:02 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-913834036"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:02 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:02 user devstack@n-api.service[61676]: INFO nova.compute.api [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Attempting to quiesce instance before volume snapshot. Apr 13 18:03:02 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-unplugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:02 user devstack@n-api.service[61676]: INFO nova.compute.api [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 13 18:03:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] Creating event network-vif-unplugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:03:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032202 Apr 13 18:03:02 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 267/810] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:02 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Creating snapshot from volume 2afce609-7ea7-4958-a9dd-326c20de27a0. {{(pid=61676) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 13 18:03:04 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-plugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] Creating event network-vif-plugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:03:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045961 Apr 13 18:03:04 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 271/811] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-831038b8-916e-42b6-bf57-aa542c055120 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd/action" status: 202 len: 0 microversion: 2.1 time: 3.445610 Apr 13 18:03:05 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 274/812] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 18:03:02 2023] POST /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd/action => generated 0 bytes in 3447 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 18:03:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-634796653", "imageRef": "d8407ca4-1a8f-4d34-98bc-d4dd18b11535", "flavorRef": "42", "networks": [{"uuid": "d901aa48-1af6-4ded-9c70-e270315524cc"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:05 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] validate_networks() for [('d901aa48-1af6-4ded-9c70-e270315524cc', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:03:06 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:06 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:06 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-b8375701-164d-4487-974d-63dcff73a525 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 200 len: 1428 microversion: 2.1 time: 0.161381 Apr 13 18:03:06 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 272/813] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:03:06 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 1428 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for user 1cd4d2b21dda452dab66c1973c3beec1 and project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:03:06 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='46d380c2-a512-4460-a1ba-c025f18ea7c1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:03:06 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.580247 Apr 13 18:03:06 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 268/814] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:03:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:03:06 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ba497336-cd3e-43c3-8646-4757a1fe540d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:06 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ba497336-cd3e-43c3-8646-4757a1fe540d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:06 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-ba497336-cd3e-43c3-8646-4757a1fe540d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:06 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ba497336-cd3e-43c3-8646-4757a1fe540d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e" status: 200 len: 1223 microversion: 2.1 time: 0.096717 Apr 13 18:03:06 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 275/815] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:03:06 2023] GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:03:07 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-plugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:07 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] Creating event network-vif-plugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:03:07 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037021 Apr 13 18:03:07 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 273/816] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:09 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-plugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:09 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] Creating event network-vif-plugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:03:09 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043119 Apr 13 18:03:09 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 269/817] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:09 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d8a738-9a43-4d3e-9127-bd95b030380e", "tag": "7787a783-eed7-4410-8507-d02d36e120ac"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:09 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] Creating event network-changed:7787a783-eed7-4410-8507-d02d36e120ac for instance 76d8a738-9a43-4d3e-9127-bd95b030380e on user Apr 13 18:03:09 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049864 Apr 13 18:03:09 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 276/818] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:12 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] HTTP exception thrown: Instance 9851b648-0b93-441b-9912-2216b528d030 could not be found. Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Request method failure captured: Apr 13 18:03:12 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030 HTTP/1.1 Apr 13 18:03:12 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:03:12 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:03:12 user devstack@n-api.service[61677]: Connection: close Apr 13 18:03:12 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:03:12 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:03:12 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:03:12 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:03:12 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEIBAuoTab9vlzLMJngLumB0Umh2fG1Zc1jm4_BVkgSmwQbLr5l9wa6O-xYWsRlUyTICGZ3mMsqkDuqCsPzx-tJN8S_peS14iTL76nFgroteP43mfuxa6MXgr0TECqfRzFbE5q31fXaviNr027spO9llW02pYIi9L3bu0AFXMBQMby4 Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Project-Id: 433b58054cc942efad3646ebf4ff286e Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestStampPattern-1307048889 Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/433b58054cc942efad3646ebf4ff286e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/433b58054cc942efad3646ebf4ff286e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/433b58054cc942efad3646ebf4ff286e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Tenant: tempest-TestStampPattern-1307048889 Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Tenant-Id: 433b58054cc942efad3646ebf4ff286e Apr 13 18:03:12 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestStampPattern-1307048889 Apr 13 18:03:12 user devstack@n-api.service[61677]: X-User: tempest-TestStampPattern-1307048889-project-member Apr 13 18:03:12 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:03:12 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:03:12 user devstack@n-api.service[61677]: X-User-Id: 2b565bc35a4742808d360a395858134b Apr 13 18:03:12 user devstack@n-api.service[61677]: X-User-Name: tempest-TestStampPattern-1307048889-project-member Apr 13 18:03:12 user devstack@n-api.service[61677]: method: > Apr 13 18:03:12 user devstack@n-api.service[61677]: exception: Instance 9851b648-0b93-441b-9912-2216b528d030 could not be found. Apr 13 18:03:12 user devstack@n-api.service[61677]: action_args: {'id': '9851b648-0b93-441b-9912-2216b528d030'} Apr 13 18:03:12 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9851b648-0b93-441b-9912-2216b528d030 could not be found. Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9851b648-0b93-441b-9912-2216b528d030 could not be found. Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9851b648-0b93-441b-9912-2216b528d030 could not be found. Apr 13 18:03:12 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:03:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Returning 404 to user: Instance 9851b648-0b93-441b-9912-2216b528d030 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:03:12 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-543678ca-b354-4743-8845-f51b422c7a5d tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030" status: 404 len: 111 microversion: 2.1 time: 0.037507 Apr 13 18:03:12 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 274/819] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:03:12 2023] GET /compute/v2.1/servers/9851b648-0b93-441b-9912-2216b528d030 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:03:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-769440c3-c0dc-49a2-bd15-bc7949788bc8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Calling method '.version_select at 0x7f82e23f9c60>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-769440c3-c0dc-49a2-bd15-bc7949788bc8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-712492187" status: 202 len: 0 microversion: 2.1 time: 0.030155 Apr 13 18:03:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 270/820] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:03:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-712492187 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:03:18 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:18 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ad9cc510-e766-4534-8d7a-34249567e776 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:18 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ad9cc510-e766-4534-8d7a-34249567e776 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad9cc510-e766-4534-8d7a-34249567e776 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad9cc510-e766-4534-8d7a-34249567e776 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad9cc510-e766-4534-8d7a-34249567e776 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad9cc510-e766-4534-8d7a-34249567e776 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad9cc510-e766-4534-8d7a-34249567e776 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ad9cc510-e766-4534-8d7a-34249567e776 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ad9cc510-e766-4534-8d7a-34249567e776 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061918 Apr 13 18:03:18 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 277/821] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 18:03:18 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:03:18 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:18 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:18 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:18 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:03:18 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 204 len: 0 microversion: 2.20 time: 0.146836 Apr 13 18:03:18 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 275/822] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 18:03:18 2023] DELETE /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:19 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:19 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:19 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:19 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-85c5d29a-5eca-48fc-9331-9772d3c76d9c tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 200 len: 1710 microversion: 2.20 time: 0.376817 Apr 13 18:03:19 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 271/823] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:03:18 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 1710 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:03:19 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "name": "network-vif-unplugged", "status": "completed", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:19 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:19 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] Creating event network-vif-unplugged:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 18:03:19 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038595 Apr 13 18:03:19 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 278/824] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:20 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "name": "network-vif-deleted", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:20 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:20 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] Creating event network-vif-deleted:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 18:03:20 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036783 Apr 13 18:03:20 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 276/825] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a", "name": "network-vif-plugged", "status": "completed", "tag": "af96f300-946c-444d-9604-b33d7fba78f3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] Creating event network-vif-plugged:af96f300-946c-444d-9604-b33d7fba78f3 for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a on user Apr 13 18:03:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029650 Apr 13 18:03:21 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 272/826] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d8a738-9a43-4d3e-9127-bd95b030380e", "name": "network-vif-plugged", "status": "completed", "tag": "7787a783-eed7-4410-8507-d02d36e120ac"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] Creating event network-vif-plugged:7787a783-eed7-4410-8507-d02d36e120ac for instance 76d8a738-9a43-4d3e-9127-bd95b030380e on user Apr 13 18:03:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031320 Apr 13 18:03:23 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 279/827] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:23 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:23 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:23 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-09cb7d20-47f8-41bd-a170-0585b2cda9a0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374" status: 200 len: 1718 microversion: 2.1 time: 0.164392 Apr 13 18:03:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 277/828] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:03:23 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:03:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d8a738-9a43-4d3e-9127-bd95b030380e", "name": "network-vif-plugged", "status": "completed", "tag": "7787a783-eed7-4410-8507-d02d36e120ac"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:03:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] Creating event network-vif-plugged:7787a783-eed7-4410-8507-d02d36e120ac for instance 76d8a738-9a43-4d3e-9127-bd95b030380e on user Apr 13 18:03:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040891 Apr 13 18:03:25 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 273/829] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:03:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=16 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:52 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:52 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:52 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c2c9844f-b503-4020-a25c-db287e7c7f46 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74" status: 200 len: 1752 microversion: 2.87 time: 0.182144 Apr 13 18:03:52 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 280/830] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:03:51 2023] GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:03:56 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:03:56 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a038227c-5a36-4115-8c89-6094414d32a5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e" status: 200 len: 1549 microversion: 2.1 time: 0.164410 Apr 13 18:03:56 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 278/831] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:03:56 2023] GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=22 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8244a462-4e23-4964-bc7a-8a27bf5b0a2f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-8244a462-4e23-4964-bc7a-8a27bf5b0a2f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8244a462-4e23-4964-bc7a-8a27bf5b0a2f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8244a462-4e23-4964-bc7a-8a27bf5b0a2f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8244a462-4e23-4964-bc7a-8a27bf5b0a2f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8244a462-4e23-4964-bc7a-8a27bf5b0a2f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8244a462-4e23-4964-bc7a-8a27bf5b0a2f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:06 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8244a462-4e23-4964-bc7a-8a27bf5b0a2f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:06 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-8244a462-4e23-4964-bc7a-8a27bf5b0a2f tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.118239 Apr 13 18:04:06 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 274/832] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:04:06 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/os-interface => generated 282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:07 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b75d41c6-6cf6-4162-b49b-c3205c128ef4", "tag": "54109c72-9d87-44b7-a358-864c31b9c96d"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:07 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:07 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:07 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:07 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] Creating event network-changed:54109c72-9d87-44b7-a358-864c31b9c96d for instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 on user Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:07 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050498 Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:07 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 281/833] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:07 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:07 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8a7d10d9-4623-412b-abda-c1927b534b42 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 200 len: 1428 microversion: 2.1 time: 0.179584 Apr 13 18:04:07 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 279/834] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:04:07 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 1428 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:04:07 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:07 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Old instance type m1.nano, new instance type m1.micro {{(pid=61678) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting quotas for user 8f796555c0e242d091502725ec595c0f and project 71e743d5e6104b55b57b4754fe7e668a. Resources: {'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:04:08 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:04:08 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/action" status: 202 len: 0 microversion: 2.1 time: 0.395152 Apr 13 18:04:08 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 275/835] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 18:04:07 2023] POST /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:04:08 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:08 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:08 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:08 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a1e8bded-6ab3-4b50-b724-fbf35d462b52 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 200 len: 1437 microversion: 2.1 time: 0.192440 Apr 13 18:04:08 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 282/836] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:04:08 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 1437 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:09 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] HTTP exception thrown: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Request method failure captured: Apr 13 18:04:09 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a HTTP/1.1 Apr 13 18:04:09 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:04:09 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:04:09 user devstack@n-api.service[61677]: Connection: close Apr 13 18:04:09 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:04:09 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:04:09 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:04:09 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:04:09 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEDYqmVnlAgUCmLuYjy-DdtqghFAC7wv4xG3zbcldYyLyz-e4f5FqUqId7VVr4lRPYC_WLZrpvqybyPcHw0TuMfLL_ZsVEvmlkOK8m2peGm5b7XMZJ6Uv1WDZHP1HkOlo3J9kzeWBnAiNUAp_wjw13DNwfiEOIVCiVNaNC7K-0xRd_M Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Project-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Tenant-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:09 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:09 user devstack@n-api.service[61677]: X-User: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:09 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:04:09 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:04:09 user devstack@n-api.service[61677]: X-User-Id: 6be9926ecd1d45d89aba2e65ac3e0bfc Apr 13 18:04:09 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:09 user devstack@n-api.service[61677]: method: > Apr 13 18:04:09 user devstack@n-api.service[61677]: exception: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:09 user devstack@n-api.service[61677]: action_args: {'id': 'ea4760b7-c4a4-4d3f-a5db-680db0f4a32a'} Apr 13 18:04:09 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:09 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:09 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Returning 404 to user: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:04:09 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8cee271c-aa95-4fdd-8ecb-4115853cea8b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 404 len: 111 microversion: 2.20 time: 0.032259 Apr 13 18:04:09 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 280/837] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:04:09 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:04:09 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-672a3291-f639-4b12-991b-9404d00ad629 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '.version_select at 0x7f82e23805e0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:09 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-672a3291-f639-4b12-991b-9404d00ad629 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-91694189" status: 204 len: 0 microversion: 2.20 time: 0.026887 Apr 13 18:04:09 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 276/838] 10.0.0.210 () {64 vars in 1333 bytes} [Thu Apr 13 18:04:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-91694189 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 18:04:09 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:09 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] Creating event network-changed:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:04:09 user devstack@n-api.service[61676]: DEBUG nova.compute.api [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61676) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 18:04:09 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038762 Apr 13 18:04:09 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 283/839] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:11 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "name": "network-vif-unplugged", "status": "completed", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}, {"server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "name": "network-vif-plugged", "status": "completed", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Creating event network-vif-unplugged:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:04:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Creating event network-vif-plugged:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:04:11 user devstack@n-api.service[61677]: DEBUG nova.compute.api [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61677) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 18:04:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044186 Apr 13 18:04:11 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 281/840] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:11 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] HTTP exception thrown: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Request method failure captured: Apr 13 18:04:12 user devstack@n-api.service[61678]: request: DELETE /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a HTTP/1.1 Apr 13 18:04:12 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:04:12 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:04:12 user devstack@n-api.service[61678]: Connection: close Apr 13 18:04:12 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:04:12 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:04:12 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:04:12 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:04:12 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEDYqmVnlAgUCmLuYjy-DdtqghFAC7wv4xG3zbcldYyLyz-e4f5FqUqId7VVr4lRPYC_WLZrpvqybyPcHw0TuMfLL_ZsVEvmlkOK8m2peGm5b7XMZJ6Uv1WDZHP1HkOlo3J9kzeWBnAiNUAp_wjw13DNwfiEOIVCiVNaNC7K-0xRd_M Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Project-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Tenant-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:12 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:12 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:12 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:04:12 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:04:12 user devstack@n-api.service[61678]: X-User-Id: 6be9926ecd1d45d89aba2e65ac3e0bfc Apr 13 18:04:12 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:12 user devstack@n-api.service[61678]: method: > Apr 13 18:04:12 user devstack@n-api.service[61678]: exception: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61678]: action_args: {'id': 'ea4760b7-c4a4-4d3f-a5db-680db0f4a32a'} Apr 13 18:04:12 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Returning 404 to user: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:04:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-bd0b421e-9469-4043-ba91-96d3c68212e5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 404 len: 111 microversion: 2.20 time: 0.027645 Apr 13 18:04:12 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 277/841] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 18:04:12 2023] DELETE /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] HTTP exception thrown: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Request method failure captured: Apr 13 18:04:12 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a HTTP/1.1 Apr 13 18:04:12 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:04:12 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:04:12 user devstack@n-api.service[61676]: Connection: close Apr 13 18:04:12 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:04:12 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:04:12 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:04:12 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:04:12 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEDYqmVnlAgUCmLuYjy-DdtqghFAC7wv4xG3zbcldYyLyz-e4f5FqUqId7VVr4lRPYC_WLZrpvqybyPcHw0TuMfLL_ZsVEvmlkOK8m2peGm5b7XMZJ6Uv1WDZHP1HkOlo3J9kzeWBnAiNUAp_wjw13DNwfiEOIVCiVNaNC7K-0xRd_M Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Project-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Tenant-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:12 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:12 user devstack@n-api.service[61676]: X-User: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:12 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:04:12 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:04:12 user devstack@n-api.service[61676]: X-User-Id: 6be9926ecd1d45d89aba2e65ac3e0bfc Apr 13 18:04:12 user devstack@n-api.service[61676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:12 user devstack@n-api.service[61676]: method: > Apr 13 18:04:12 user devstack@n-api.service[61676]: exception: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61676]: action_args: {'id': 'ea4760b7-c4a4-4d3f-a5db-680db0f4a32a'} Apr 13 18:04:12 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. Apr 13 18:04:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:04:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Returning 404 to user: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:04:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-b1074f56-21ce-42c1-bd95-55a327453a4e tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" status: 404 len: 111 microversion: 2.20 time: 0.031494 Apr 13 18:04:12 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 284/842] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:04:12 2023] GET /compute/v2.1/servers/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:15 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] HTTP exception thrown: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Request method failure captured: Apr 13 18:04:15 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa HTTP/1.1 Apr 13 18:04:15 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:04:15 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:04:15 user devstack@n-api.service[61677]: Connection: close Apr 13 18:04:15 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:04:15 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:04:15 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:04:15 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:04:15 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEDYqmVnlAgUCmLuYjy-DdtqghFAC7wv4xG3zbcldYyLyz-e4f5FqUqId7VVr4lRPYC_WLZrpvqybyPcHw0TuMfLL_ZsVEvmlkOK8m2peGm5b7XMZJ6Uv1WDZHP1HkOlo3J9kzeWBnAiNUAp_wjw13DNwfiEOIVCiVNaNC7K-0xRd_M Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Project-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Tenant-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:15 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:15 user devstack@n-api.service[61677]: X-User: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:15 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:04:15 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:04:15 user devstack@n-api.service[61677]: X-User-Id: 6be9926ecd1d45d89aba2e65ac3e0bfc Apr 13 18:04:15 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:15 user devstack@n-api.service[61677]: method: > Apr 13 18:04:15 user devstack@n-api.service[61677]: exception: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61677]: action_args: {'id': '1753314b-bfd7-4e8b-986b-0253666ab8aa'} Apr 13 18:04:15 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Returning 404 to user: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:04:15 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-89b7f56f-0f43-440f-a1db-c25ee637af09 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 404 len: 111 microversion: 2.20 time: 0.054633 Apr 13 18:04:15 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 282/843] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 18:04:15 2023] DELETE /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] HTTP exception thrown: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Request method failure captured: Apr 13 18:04:15 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa HTTP/1.1 Apr 13 18:04:15 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:04:15 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:04:15 user devstack@n-api.service[61678]: Connection: close Apr 13 18:04:15 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:04:15 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:04:15 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:04:15 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:04:15 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEDYqmVnlAgUCmLuYjy-DdtqghFAC7wv4xG3zbcldYyLyz-e4f5FqUqId7VVr4lRPYC_WLZrpvqybyPcHw0TuMfLL_ZsVEvmlkOK8m2peGm5b7XMZJ6Uv1WDZHP1HkOlo3J9kzeWBnAiNUAp_wjw13DNwfiEOIVCiVNaNC7K-0xRd_M Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Project-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3589c01630f4f83a6925d97943c574b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Tenant-Id: c3589c01630f4f83a6925d97943c574b Apr 13 18:04:15 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896381340 Apr 13 18:04:15 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:15 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:04:15 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:04:15 user devstack@n-api.service[61678]: X-User-Id: 6be9926ecd1d45d89aba2e65ac3e0bfc Apr 13 18:04:15 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896381340-project-member Apr 13 18:04:15 user devstack@n-api.service[61678]: method: > Apr 13 18:04:15 user devstack@n-api.service[61678]: exception: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61678]: action_args: {'id': '1753314b-bfd7-4e8b-986b-0253666ab8aa'} Apr 13 18:04:15 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. Apr 13 18:04:15 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:04:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Returning 404 to user: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:04:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-262043dc-038d-4255-9fc7-686b268ee8c5 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa" status: 404 len: 111 microversion: 2.20 time: 0.029050 Apr 13 18:04:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 278/844] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:04:15 2023] GET /compute/v2.1/servers/1753314b-bfd7-4e8b-986b-0253666ab8aa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:04:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "name": "network-vif-plugged", "status": "completed", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:23 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:23 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=14 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] Creating event network-vif-plugged:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:04:23 user devstack@n-api.service[61676]: DEBUG nova.compute.api [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61676) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 18:04:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043894 Apr 13 18:04:23 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 285/845] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-294a7a3a-d160-4abd-b56b-dbc1b680bc92 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-294a7a3a-d160-4abd-b56b-dbc1b680bc92 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294a7a3a-d160-4abd-b56b-dbc1b680bc92 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294a7a3a-d160-4abd-b56b-dbc1b680bc92 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294a7a3a-d160-4abd-b56b-dbc1b680bc92 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294a7a3a-d160-4abd-b56b-dbc1b680bc92 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294a7a3a-d160-4abd-b56b-dbc1b680bc92 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-294a7a3a-d160-4abd-b56b-dbc1b680bc92 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-294a7a3a-d160-4abd-b56b-dbc1b680bc92 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.096533 Apr 13 18:04:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 283/846] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:04:24 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-interface => generated 283 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:25 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:25 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:25 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] Creating event network-changed:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:04:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189061 Apr 13 18:04:25 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 279/847] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:25 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:25 user devstack@n-api.service[61676]: DEBUG nova.objects.instance [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'services' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=61676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:04:25 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments/c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b" status: 202 len: 0 microversion: 2.1 time: 0.218168 Apr 13 18:04:25 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 286/848] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:04:25 2023] DELETE /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments/c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:04:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-08c1d24a-fe58-4961-b599-d26330869d05 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:25 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-08c1d24a-fe58-4961-b599-d26330869d05 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-08c1d24a-fe58-4961-b599-d26330869d05 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-08c1d24a-fe58-4961-b599-d26330869d05 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-08c1d24a-fe58-4961-b599-d26330869d05 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-08c1d24a-fe58-4961-b599-d26330869d05 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-08c1d24a-fe58-4961-b599-d26330869d05 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-08c1d24a-fe58-4961-b599-d26330869d05 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-08c1d24a-fe58-4961-b599-d26330869d05 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057180 Apr 13 18:04:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 284/849] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:04:25 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "name": "network-vif-plugged", "status": "completed", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] Creating event network-vif-plugged:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:04:26 user devstack@n-api.service[61678]: DEBUG nova.compute.api [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61678) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 18:04:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038357 Apr 13 18:04:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 280/850] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:27 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:27 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] Creating event network-changed:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:04:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032314 Apr 13 18:04:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 287/851] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:04:28 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-fef5547c-acfa-444b-986d-0650fc990219 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: .version_select at 0x7f82e220c430>, body: {"keypair": {"name": "tempest-keypair-577728192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdOxamXsTXlK9OaACIf8bLScnUWpSxIKftQ3YDg8S6W9dnCJz+Vc57VKW/FCcFWKyA9NE0qEvzGl+mNUFxlstDlQsrnA13xf1V3Tn1dbJC7Ms2tKG6E+lwchAc6RaZqgg=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:28 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-fef5547c-acfa-444b-986d-0650fc990219 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:04:28 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-fef5547c-acfa-444b-986d-0650fc990219 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for user 0ac81be2a2db40b2acbae911db8086ca and project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:04:28 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-fef5547c-acfa-444b-986d-0650fc990219 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147495 Apr 13 18:04:28 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 285/852] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:04:28 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1571357563", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "182886ee-6e1e-4146-903d-955b8b6726f4"}], "security_groups": [{"name": "tempest-securitygroup--1396897917"}], "key_name": "tempest-keypair-577728192", "user_data": "}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:30 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] validate_networks() for [('182886ee-6e1e-4146-903d-955b8b6726f4', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for user 0ac81be2a2db40b2acbae911db8086ca and project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:04:31 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:04:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.134509 Apr 13 18:04:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 281/853] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:04:30 2023] POST /compute/v2.1/servers => generated 400 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:04:31 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-9740d682-0cde-4f51-982b-8361845e3392 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:31 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-9740d682-0cde-4f51-982b-8361845e3392 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:31 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-9740d682-0cde-4f51-982b-8361845e3392 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:31 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-9740d682-0cde-4f51-982b-8361845e3392 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5" status: 200 len: 1235 microversion: 2.1 time: 0.089877 Apr 13 18:04:31 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 288/854] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:04:31 2023] GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => generated 1235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:04:34 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b65bfd-ef04-44fc-b5bf-f4742705b8b5", "tag": "e3e2fd87-b819-444d-afc1-f02005f3cedc"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] Creating event network-changed:e3e2fd87-b819-444d-afc1-f02005f3cedc for instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 on user Apr 13 18:04:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043448 Apr 13 18:04:34 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 286/855] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:36 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b65bfd-ef04-44fc-b5bf-f4742705b8b5", "name": "network-vif-plugged", "status": "completed", "tag": "e3e2fd87-b819-444d-afc1-f02005f3cedc"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:36 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:36 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:36 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] Creating event network-vif-plugged:e3e2fd87-b819-444d-afc1-f02005f3cedc for instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 on user Apr 13 18:04:36 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048772 Apr 13 18:04:36 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 282/856] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b65bfd-ef04-44fc-b5bf-f4742705b8b5", "name": "network-vif-plugged", "status": "completed", "tag": "e3e2fd87-b819-444d-afc1-f02005f3cedc"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:38 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] Creating event network-vif-plugged:e3e2fd87-b819-444d-afc1-f02005f3cedc for instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 on user Apr 13 18:04:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036201 Apr 13 18:04:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 289/857] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=26 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74/action" status: 202 len: 0 microversion: 2.87 time: 0.085141 Apr 13 18:04:52 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 287/858] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 18:04:52 2023] POST /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:52 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-354d439c-3657-45df-82fd-c3fcb34d22cb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74" status: 200 len: 1760 microversion: 2.87 time: 0.196486 Apr 13 18:04:52 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 283/859] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:04:52 2023] GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 => generated 1760 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:04:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=12 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:04:52 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-unplugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] Creating event network-vif-unplugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:04:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036277 Apr 13 18:04:52 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 290/860] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:55 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-plugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}, {"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-plugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Creating event network-vif-plugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:04:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Creating event network-vif-plugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:04:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034665 Apr 13 18:04:55 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 288/861] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:56 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:56 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:56 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:56 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-15e8112e-3870-4c01-89c7-92733fadd68a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e" status: 200 len: 1549 microversion: 2.1 time: 0.173991 Apr 13 18:04:56 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 284/862] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:04:56 2023] GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:04:57 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-plugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:57 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:57 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:57 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:57 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] Creating event network-vif-plugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:04:57 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029307 Apr 13 18:04:57 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 289/863] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:57 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:04:57 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e" status: 204 len: 0 microversion: 2.1 time: 0.145853 Apr 13 18:04:57 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 291/864] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:04:57 2023] DELETE /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:04:57 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:57 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:57 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:57 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:57 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-48714717-94da-419f-ac3c-9260f4437be1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e" status: 200 len: 1555 microversion: 2.1 time: 0.202915 Apr 13 18:04:57 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 285/865] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:04:57 2023] GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:04:58 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:04:58 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:04:58 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:58 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:58 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:58 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:58 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:58 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:58 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:04:58 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3fab8ce6-86d6-4d23-a7bd-3d02ab0ab122 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 200 len: 1555 microversion: 2.1 time: 0.182876 Apr 13 18:04:58 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 290/866] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:04:58 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:04:58 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d8a738-9a43-4d3e-9127-bd95b030380e", "name": "network-vif-deleted", "tag": "7787a783-eed7-4410-8507-d02d36e120ac"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:58 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] Creating event network-vif-deleted:7787a783-eed7-4410-8507-d02d36e120ac for instance 76d8a738-9a43-4d3e-9127-bd95b030380e on user Apr 13 18:04:58 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031495 Apr 13 18:04:58 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 292/867] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:04:59 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d8a738-9a43-4d3e-9127-bd95b030380e", "name": "network-vif-unplugged", "status": "completed", "tag": "7787a783-eed7-4410-8507-d02d36e120ac"}, {"server_uuid": "76d8a738-9a43-4d3e-9127-bd95b030380e", "name": "network-vif-plugged", "status": "completed", "tag": "7787a783-eed7-4410-8507-d02d36e120ac"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:04:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:04:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:04:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:04:59 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Creating event network-vif-unplugged:7787a783-eed7-4410-8507-d02d36e120ac for instance 76d8a738-9a43-4d3e-9127-bd95b030380e on user Apr 13 18:04:59 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Creating event network-vif-plugged:7787a783-eed7-4410-8507-d02d36e120ac for instance 76d8a738-9a43-4d3e-9127-bd95b030380e on user Apr 13 18:04:59 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046467 Apr 13 18:04:59 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 286/868] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:04:59 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a0eeca90-bd40-4f2c-b682-bd5cb4d6e64b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-a0eeca90-bd40-4f2c-b682-bd5cb4d6e64b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=8 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a0eeca90-bd40-4f2c-b682-bd5cb4d6e64b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a0eeca90-bd40-4f2c-b682-bd5cb4d6e64b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a0eeca90-bd40-4f2c-b682-bd5cb4d6e64b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a0eeca90-bd40-4f2c-b682-bd5cb4d6e64b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a0eeca90-bd40-4f2c-b682-bd5cb4d6e64b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-a0eeca90-bd40-4f2c-b682-bd5cb4d6e64b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:15 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a0eeca90-bd40-4f2c-b682-bd5cb4d6e64b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.360871 Apr 13 18:05:15 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 291/869] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:05:15 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/os-volume_attachments => generated 25 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:05:15 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:15 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:16 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:05:16 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:16 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:16 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:05:16 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374" status: 204 len: 0 microversion: 2.1 time: 0.120499 Apr 13 18:05:16 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 293/870] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:05:15 2023] DELETE /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=11 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=20 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:16 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:05:16 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-05387bf7-b68f-4d4a-aa46-db2937c95c53 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374" status: 200 len: 1678 microversion: 2.1 time: 0.549085 Apr 13 18:05:16 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 287/871] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:05:16 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => generated 1678 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:05:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-unplugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:05:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] Creating event network-vif-unplugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:05:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048955 Apr 13 18:05:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 292/872] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:05:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:05:17 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-deleted", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:05:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:17 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] Creating event network-vif-deleted:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:05:17 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033355 Apr 13 18:05:17 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 294/873] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:05:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:05:18 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2b2a73-ff8a-4357-bad3-6be8fd95b374", "name": "network-vif-plugged", "status": "completed", "tag": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:05:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] Creating event network-vif-plugged:2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 on user Apr 13 18:05:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037944 Apr 13 18:05:18 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 288/874] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:05:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:05:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:05:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:21 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:05:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-ebffef15-335d-4ff7-acfa-129b5b95bcfa tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5" status: 200 len: 1546 microversion: 2.1 time: 0.180388 Apr 13 18:05:21 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 293/875] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:05:21 2023] GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => generated 1546 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:05:42 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:05:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-fc219ceb-6d96-4bd5-a46d-8f5afd281c2f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74" status: 200 len: 1766 microversion: 2.87 time: 0.172927 Apr 13 18:05:42 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 295/876] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:05:42 2023] GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 => generated 1766 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=8 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:05:47 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e HTTP/1.1 Apr 13 18:05:47 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:05:47 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:05:47 user devstack@n-api.service[61678]: Connection: close Apr 13 18:05:47 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:05:47 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:05:47 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:05:47 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:05:47 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:05:47 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:05:47 user devstack@n-api.service[61678]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:05:47 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:05:47 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:05:47 user devstack@n-api.service[61678]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:05:47 user devstack@n-api.service[61678]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:05:47 user devstack@n-api.service[61678]: method: > Apr 13 18:05:47 user devstack@n-api.service[61678]: exception: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:05:47 user devstack@n-api.service[61678]: action_args: {'id': '76d8a738-9a43-4d3e-9127-bd95b030380e'} Apr 13 18:05:47 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:05:47 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:05:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:05:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-6f4dc26a-d971-4ab0-b1cc-fdd012c4fccf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e" status: 404 len: 111 microversion: 2.1 time: 0.037930 Apr 13 18:05:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 289/877] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:05:47 2023] GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=14 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:49 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:05:49 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd" status: 204 len: 0 microversion: 2.1 time: 0.112569 Apr 13 18:05:49 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 294/878] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:05:49 2023] DELETE /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:05:49 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:05:49 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:49 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:05:50 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-08f7ca2f-47d5-489d-ae1c-2f4d97520730 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd" status: 200 len: 1399 microversion: 2.1 time: 0.177039 Apr 13 18:05:50 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 296/879] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:05:49 2023] GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd => generated 1399 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:05:50 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35e0e9b-3b18-4ef8-8299-bff7643aaccd", "name": "network-vif-unplugged", "status": "completed", "tag": "780a9174-8b86-4c52-a264-92a4224ba2a3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:05:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:50 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] Creating event network-vif-unplugged:780a9174-8b86-4c52-a264-92a4224ba2a3 for instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd on user Apr 13 18:05:50 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029775 Apr 13 18:05:50 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 290/880] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:05:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:05:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35e0e9b-3b18-4ef8-8299-bff7643aaccd", "name": "network-vif-plugged", "status": "completed", "tag": "780a9174-8b86-4c52-a264-92a4224ba2a3"}, {"server_uuid": "b35e0e9b-3b18-4ef8-8299-bff7643aaccd", "name": "network-vif-deleted", "tag": "780a9174-8b86-4c52-a264-92a4224ba2a3"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:05:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] Creating event network-vif-plugged:780a9174-8b86-4c52-a264-92a4224ba2a3 for instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd on user Apr 13 18:05:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] Creating event network-vif-deleted:780a9174-8b86-4c52-a264-92a4224ba2a3 for instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd on user Apr 13 18:05:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032196 Apr 13 18:05:52 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 295/881] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:05:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:05:58 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:05:58 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:58 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:58 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/action" status: 204 len: 0 microversion: 2.1 time: 0.068821 Apr 13 18:05:58 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 297/882] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 18:05:58 2023] POST /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:05:58 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:05:58 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:05:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:05:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:05:58 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:05:58 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:05:58 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-be79aac9-e5e0-40f6-8ad5-5d8e421e8869 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 200 len: 1555 microversion: 2.1 time: 0.259673 Apr 13 18:05:58 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 291/883] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:05:58 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 1555 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] HTTP exception thrown: Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 could not be found. Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Request method failure captured: Apr 13 18:06:06 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 HTTP/1.1 Apr 13 18:06:06 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:06:06 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:06:06 user devstack@n-api.service[61677]: Connection: close Apr 13 18:06:06 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:06:06 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:06:06 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:06:06 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:06:06 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEDQnq4eQIZsnZOBn_j0_FU-f6LzfH5sy33GgC-hZqDIpXlV9V16O3ymT_4_jNnW8zh3Wer2j7e-5Vd1U0kX2BDIXPghI3-OHKVTmGKeSIMWv8bHIM3PWyuZyexyDKi3Zc4I686nabAZRhg5TYwZuKE4MHrKq5Bakp5f8QPHOtRfXWo Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Project-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Tenant: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Tenant-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 18:06:06 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:06:06 user devstack@n-api.service[61677]: X-User: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 18:06:06 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:06:06 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:06:06 user devstack@n-api.service[61677]: X-User-Id: 8f1fe2e6fd894d5c87d7ccf5fae553ca Apr 13 18:06:06 user devstack@n-api.service[61677]: X-User-Name: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 18:06:06 user devstack@n-api.service[61677]: method: > Apr 13 18:06:06 user devstack@n-api.service[61677]: exception: Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 could not be found. Apr 13 18:06:06 user devstack@n-api.service[61677]: action_args: {'id': 'dd2b2a73-ff8a-4357-bad3-6be8fd95b374'} Apr 13 18:06:06 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 could not be found. Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 could not be found. Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 could not be found. Apr 13 18:06:06 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:06 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Returning 404 to user: Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:06:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-20e40380-9ad4-4cfd-80d4-14d3c535924f tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374" status: 404 len: 111 microversion: 2.1 time: 0.050028 Apr 13 18:06:06 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 296/884] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:06:06 2023] GET /compute/v2.1/servers/dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:06:06 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f047d6d4-5921-4783-b27c-2bcc6dd071f0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '.version_select at 0x7f82e23ed000>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:06 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f047d6d4-5921-4783-b27c-2bcc6dd071f0 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158147748" status: 202 len: 0 microversion: 2.1 time: 0.024097 Apr 13 18:06:06 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 298/885] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 18:06:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158147748 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=10 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:12 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:06:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f" status: 204 len: 0 microversion: 2.1 time: 0.136080 Apr 13 18:06:13 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 292/886] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:06:12 2023] DELETE /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:06:13 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:13 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:13 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "name": "network-vif-unplugged", "status": "completed", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:13 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:13 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:13 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] Creating event network-vif-unplugged:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 18:06:13 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040625 Apr 13 18:06:13 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 299/887] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:13 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:06:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-75610770-aed8-4df0-bf0c-6b46f9729b8b tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f" status: 200 len: 1495 microversion: 2.1 time: 0.630728 Apr 13 18:06:13 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 297/888] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:06:13 2023] GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f => generated 1495 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:06:14 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "name": "network-vif-deleted", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:14 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] Creating event network-vif-deleted:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 18:06:14 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Apr 13 18:06:14 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 293/889] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:15 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e6a724-a30a-49db-8e06-fd1da3e57c6f", "name": "network-vif-plugged", "status": "completed", "tag": "1264cd6a-928d-4e98-808e-0911f5498d48"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] Creating event network-vif-plugged:1264cd6a-928d-4e98-808e-0911f5498d48 for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f on user Apr 13 18:06:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049176 Apr 13 18:06:15 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 300/890] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-c5b8b86b-9868-48d0-87bc-c948eb09a506 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-c5b8b86b-9868-48d0-87bc-c948eb09a506 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c5b8b86b-9868-48d0-87bc-c948eb09a506 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c5b8b86b-9868-48d0-87bc-c948eb09a506 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c5b8b86b-9868-48d0-87bc-c948eb09a506 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c5b8b86b-9868-48d0-87bc-c948eb09a506 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c5b8b86b-9868-48d0-87bc-c948eb09a506 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-c5b8b86b-9868-48d0-87bc-c948eb09a506 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-c5b8b86b-9868-48d0-87bc-c948eb09a506 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.101977 Apr 13 18:06:21 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 298/891] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:06:21 2023] GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-interface => generated 283 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:22 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b65bfd-ef04-44fc-b5bf-f4742705b8b5", "tag": "e3e2fd87-b819-444d-afc1-f02005f3cedc"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] Creating event network-changed:e3e2fd87-b819-444d-afc1-f02005f3cedc for instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 on user Apr 13 18:06:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031688 Apr 13 18:06:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 294/892] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f7222aa2-2594-405a-bff0-3e876fc506fc tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f7222aa2-2594-405a-bff0-3e876fc506fc tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f7222aa2-2594-405a-bff0-3e876fc506fc tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f7222aa2-2594-405a-bff0-3e876fc506fc tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f7222aa2-2594-405a-bff0-3e876fc506fc tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f7222aa2-2594-405a-bff0-3e876fc506fc tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f7222aa2-2594-405a-bff0-3e876fc506fc tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f7222aa2-2594-405a-bff0-3e876fc506fc tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f7222aa2-2594-405a-bff0-3e876fc506fc tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/ips" status: 200 len: 109 microversion: 2.1 time: 0.038193 Apr 13 18:06:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 301/893] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 18:06:22 2023] GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:25 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89cc9680-5d37-4798-a49f-0ff6e2466a65"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:25 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:25 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274829 Apr 13 18:06:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 299/894] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:06:25 2023] POST /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:32 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f2b55339-3ec1-452d-a90f-dca7efd04f51 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: .version_select at 0x7f82e2571240>, body: {"keypair": {"name": "tempest-keypair-178076479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqinz0f+Srx0RHqsyD7wdwBE+v8apdgAhWJzH46gkIq3HKViJJoCKH4sGZq4DoJ3iERs9Dhb6QdQ51Wr/Wxj1KP6O7XWQx5Z/MbyWgkbJNMqmk5H4sf3Mz7PmXSDDqy9g=="}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:32 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-f2b55339-3ec1-452d-a90f-dca7efd04f51 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:06:32 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-f2b55339-3ec1-452d-a90f-dca7efd04f51 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for user 0ac81be2a2db40b2acbae911db8086ca and project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'key_pairs'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:06:32 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f2b55339-3ec1-452d-a90f-dca7efd04f51 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058635 Apr 13 18:06:32 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 295/895] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:06:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1438706224", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "182886ee-6e1e-4146-903d-955b8b6726f4"}], "security_groups": [{"name": "tempest-securitygroup--2069496912"}], "key_name": "tempest-keypair-178076479", "user_data": "}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:33 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=5 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:33 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:33 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] validate_networks() for [('182886ee-6e1e-4146-903d-955b8b6726f4', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for user 0ac81be2a2db40b2acbae911db8086ca and project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:06:34 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:06:34 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.723925 Apr 13 18:06:34 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 302/896] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:06:33 2023] POST /compute/v2.1/servers => generated 400 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:06:34 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-719c286e-70a8-45a2-a9de-798e7c40cb42 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:34 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-719c286e-70a8-45a2-a9de-798e7c40cb42 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:34 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-719c286e-70a8-45a2-a9de-798e7c40cb42 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:06:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-719c286e-70a8-45a2-a9de-798e7c40cb42 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc" status: 200 len: 1235 microversion: 2.1 time: 0.063432 Apr 13 18:06:34 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 300/897] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:06:34 2023] GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc => generated 1235 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:06:36 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:36 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94db3503-3352-4326-b52a-f8af1061fafc", "tag": "aee67ff9-a673-4687-901d-66e22a39d83c"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:36 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] Creating event network-changed:aee67ff9-a673-4687-901d-66e22a39d83c for instance 94db3503-3352-4326-b52a-f8af1061fafc on user Apr 13 18:06:36 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086331 Apr 13 18:06:36 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 296/898] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94db3503-3352-4326-b52a-f8af1061fafc", "name": "network-vif-plugged", "status": "completed", "tag": "aee67ff9-a673-4687-901d-66e22a39d83c"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] Creating event network-vif-plugged:aee67ff9-a673-4687-901d-66e22a39d83c for instance 94db3503-3352-4326-b52a-f8af1061fafc on user Apr 13 18:06:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Apr 13 18:06:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 303/899] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=13 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:06:40 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd HTTP/1.1 Apr 13 18:06:40 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:06:40 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:06:40 user devstack@n-api.service[61677]: Connection: close Apr 13 18:06:40 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:06:40 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:06:40 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:06:40 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:06:40 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61677]: method: > Apr 13 18:06:40 user devstack@n-api.service[61677]: exception: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: action_args: {'id': 'b35e0e9b-3b18-4ef8-8299-bff7643aaccd'} Apr 13 18:06:40 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:06:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f656b263-ccf5-4e07-a25a-97fd5ad42729 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd" status: 404 len: 111 microversion: 2.1 time: 0.037920 Apr 13 18:06:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 301/900] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:06:40 2023] GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:06:40 user devstack@n-api.service[61678]: request: DELETE /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e HTTP/1.1 Apr 13 18:06:40 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:06:40 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:06:40 user devstack@n-api.service[61678]: Connection: close Apr 13 18:06:40 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:06:40 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:06:40 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:06:40 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:06:40 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61678]: method: > Apr 13 18:06:40 user devstack@n-api.service[61678]: exception: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: action_args: {'id': '76d8a738-9a43-4d3e-9127-bd95b030380e'} Apr 13 18:06:40 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:06:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-21f2d6ad-ccca-4ec6-9ffc-9dba64283788 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e" status: 404 len: 111 microversion: 2.1 time: 0.029777 Apr 13 18:06:40 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 297/901] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:06:40 2023] DELETE /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:06:40 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e HTTP/1.1 Apr 13 18:06:40 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:06:40 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:06:40 user devstack@n-api.service[61676]: Connection: close Apr 13 18:06:40 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:06:40 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:06:40 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:06:40 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:06:40 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61676]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61676]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:06:40 user devstack@n-api.service[61676]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61676]: method: > Apr 13 18:06:40 user devstack@n-api.service[61676]: exception: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61676]: action_args: {'id': '76d8a738-9a43-4d3e-9127-bd95b030380e'} Apr 13 18:06:40 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. Apr 13 18:06:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:06:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a568fb61-4b56-4f4d-be50-07b6bd738091 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e" status: 404 len: 111 microversion: 2.1 time: 0.027544 Apr 13 18:06:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 304/902] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:06:40 2023] GET /compute/v2.1/servers/76d8a738-9a43-4d3e-9127-bd95b030380e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:06:40 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd HTTP/1.1 Apr 13 18:06:40 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:06:40 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:06:40 user devstack@n-api.service[61677]: Connection: close Apr 13 18:06:40 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:06:40 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:06:40 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:06:40 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:06:40 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:06:40 user devstack@n-api.service[61677]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61677]: method: > Apr 13 18:06:40 user devstack@n-api.service[61677]: exception: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: action_args: {'id': 'b35e0e9b-3b18-4ef8-8299-bff7643aaccd'} Apr 13 18:06:40 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:06:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-e8195c09-b4e9-48e3-aec7-f6aa4606b9cc tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd" status: 404 len: 111 microversion: 2.1 time: 0.031157 Apr 13 18:06:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 302/903] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:06:40 2023] DELETE /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:06:40 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd HTTP/1.1 Apr 13 18:06:40 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:06:40 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:06:40 user devstack@n-api.service[61678]: Connection: close Apr 13 18:06:40 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:06:40 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:06:40 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:06:40 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:06:40 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:06:40 user devstack@n-api.service[61678]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:06:40 user devstack@n-api.service[61678]: method: > Apr 13 18:06:40 user devstack@n-api.service[61678]: exception: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: action_args: {'id': 'b35e0e9b-3b18-4ef8-8299-bff7643aaccd'} Apr 13 18:06:40 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. Apr 13 18:06:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:06:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:06:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-88780bd1-cb8f-4a55-a807-3cf124610a42 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd" status: 404 len: 111 microversion: 2.1 time: 0.027574 Apr 13 18:06:40 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 298/904] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:06:40 2023] GET /compute/v2.1/servers/b35e0e9b-3b18-4ef8-8299-bff7643aaccd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-8492946f-5b4b-4e05-b0da-666929915c12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Action: 'create', calling method: .version_select at 0x7f82e2550f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1422503133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw=="}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-8492946f-5b4b-4e05-b0da-666929915c12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for project 25f789d52faa469c802d7c1281ed8c82. Resources: {'key_pairs'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:06:40 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-8492946f-5b4b-4e05-b0da-666929915c12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for user 1cd4d2b21dda452dab66c1973c3beec1 and project 25f789d52faa469c802d7c1281ed8c82. Resources: {'key_pairs'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:06:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-8492946f-5b4b-4e05-b0da-666929915c12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.045907 Apr 13 18:06:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 305/905] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:06:40 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:41 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94db3503-3352-4326-b52a-f8af1061fafc", "name": "network-vif-plugged", "status": "completed", "tag": "aee67ff9-a673-4687-901d-66e22a39d83c"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:41 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:41 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] Creating event network-vif-plugged:aee67ff9-a673-4687-901d-66e22a39d83c for instance 94db3503-3352-4326-b52a-f8af1061fafc on user Apr 13 18:06:41 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032418 Apr 13 18:06:41 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 303/906] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:06:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74" status: 204 len: 0 microversion: 2.87 time: 0.233042 Apr 13 18:06:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 299/907] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 18:06:42 2023] DELETE /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 18:06:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:42 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:43 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:06:43 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:06:43 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:06:43 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-fe843a63-ed27-4878-be62-db3109b12518 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74" status: 200 len: 1772 microversion: 2.87 time: 0.276070 Apr 13 18:06:43 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 306/908] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:06:42 2023] GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 => generated 1772 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:06:43 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-unplugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:43 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:43 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] Creating event network-vif-unplugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:06:43 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032910 Apr 13 18:06:43 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 304/909] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:06:44 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-efeafbcf-cd98-45f3-8fb2-bfdfef74cc94 req-266995aa-2d73-4bbe-bdc1-efed26f753e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-deleted", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:44 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-efeafbcf-cd98-45f3-8fb2-bfdfef74cc94 req-266995aa-2d73-4bbe-bdc1-efed26f753e6 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:44 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-efeafbcf-cd98-45f3-8fb2-bfdfef74cc94 req-266995aa-2d73-4bbe-bdc1-efed26f753e6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:44 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-efeafbcf-cd98-45f3-8fb2-bfdfef74cc94 req-266995aa-2d73-4bbe-bdc1-efed26f753e6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:44 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-efeafbcf-cd98-45f3-8fb2-bfdfef74cc94 req-266995aa-2d73-4bbe-bdc1-efed26f753e6 service nova] Creating event network-vif-deleted:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:06:44 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-efeafbcf-cd98-45f3-8fb2-bfdfef74cc94 req-266995aa-2d73-4bbe-bdc1-efed26f753e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034800 Apr 13 18:06:44 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 300/910] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:44 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-96331133", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1422503133", "security_groups": [{"name": "tempest-secgroup-smoke-1400552645"}], "block_device_mapping_v2": [{"uuid": "329d61b0-027c-48c2-a0a1-0a93645302ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d901aa48-1af6-4ded-9c70-e270315524cc"}]}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:44 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.network.neutron [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] validate_networks() for [('d901aa48-1af6-4ded-9c70-e270315524cc', None, None, None, None, None)] {{(pid=61676) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:06:45 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:06:45 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e2740-4711-4a10-b099-0a8e5efdbb74", "name": "network-vif-plugged", "status": "completed", "tag": "8931403f-8458-4b81-b911-280a70e1869a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:45 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] Creating event network-vif-plugged:8931403f-8458-4b81-b911-280a70e1869a for instance f77e2740-4711-4a10-b099-0a8e5efdbb74 on user Apr 13 18:06:45 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031122 Apr 13 18:06:45 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 305/911] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.quota [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for user 1cd4d2b21dda452dab66c1973c3beec1 and project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Going to run 1 instances... {{(pid=61676) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:06:45 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='329d61b0-027c-48c2-a0a1-0a93645302ce',volume_size=None,volume_type=None)] {{(pid=61676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:06:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.813520 Apr 13 18:06:45 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 307/912] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:06:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:06:45 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ea5978ab-2638-4dae-a709-467c35efa1c5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:45 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ea5978ab-2638-4dae-a709-467c35efa1c5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:45 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-ea5978ab-2638-4dae-a709-467c35efa1c5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:06:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ea5978ab-2638-4dae-a709-467c35efa1c5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3" status: 200 len: 1088 microversion: 2.1 time: 0.069637 Apr 13 18:06:45 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 301/913] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:06:45 2023] GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:06:48 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5342d27-7121-489f-b1b7-c02d664e7fc3", "tag": "85b82f0f-9e05-4ff1-aec6-4530a2b04740"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:48 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:48 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] Creating event network-changed:85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance c5342d27-7121-489f-b1b7-c02d664e7fc3 on user Apr 13 18:06:48 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033529 Apr 13 18:06:48 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 306/914] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:49 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:06:49 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:06:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:49 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:06:49 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c02c238c-5d58-4118-b6a6-79e68d8ac706 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 200 len: 1547 microversion: 2.1 time: 0.182065 Apr 13 18:06:49 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 308/915] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:06:49 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 1547 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:06:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5342d27-7121-489f-b1b7-c02d664e7fc3", "name": "network-vif-plugged", "status": "completed", "tag": "85b82f0f-9e05-4ff1-aec6-4530a2b04740"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] Creating event network-vif-plugged:85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance c5342d27-7121-489f-b1b7-c02d664e7fc3 on user Apr 13 18:06:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042692 Apr 13 18:06:54 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 302/916] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:06:56 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5342d27-7121-489f-b1b7-c02d664e7fc3", "name": "network-vif-plugged", "status": "completed", "tag": "85b82f0f-9e05-4ff1-aec6-4530a2b04740"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:06:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:06:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:06:56 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:06:56 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] Creating event network-vif-plugged:85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance c5342d27-7121-489f-b1b7-c02d664e7fc3 on user Apr 13 18:06:56 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034286 Apr 13 18:06:56 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 307/917] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:06:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=16 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=7 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=20 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] HTTP exception thrown: Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f could not be found. Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Request method failure captured: Apr 13 18:07:03 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f HTTP/1.1 Apr 13 18:07:03 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:07:03 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:07:03 user devstack@n-api.service[61676]: Connection: close Apr 13 18:07:03 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:07:03 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:07:03 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:07:03 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:07:03 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEDQnq4eQIZsnZOBn_j0_FU-f6LzfH5sy33GgC-hZqDIpXlV9V16O3ymT_4_jNnW8zh3Wer2j7e-5Vd1U0kX2BDIXPghI3-OHKVTmGKeSIMWv8bHIM3PWyuZyexyDKi3Zc4I686nabAZRhg5TYwZuKE4MHrKq5Bakp5f8QPHOtRfXWo Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Project-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Tenant: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Tenant-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 18:07:03 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:07:03 user devstack@n-api.service[61676]: X-User: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 18:07:03 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:07:03 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:07:03 user devstack@n-api.service[61676]: X-User-Id: 8f1fe2e6fd894d5c87d7ccf5fae553ca Apr 13 18:07:03 user devstack@n-api.service[61676]: X-User-Name: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 18:07:03 user devstack@n-api.service[61676]: method: > Apr 13 18:07:03 user devstack@n-api.service[61676]: exception: Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f could not be found. Apr 13 18:07:03 user devstack@n-api.service[61676]: action_args: {'id': '42e6a724-a30a-49db-8e06-fd1da3e57c6f'} Apr 13 18:07:03 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f could not be found. Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f could not be found. Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f could not be found. Apr 13 18:07:03 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:07:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Returning 404 to user: Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:07:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1bd4df7a-82f2-4be9-9b59-0395159c377a tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f" status: 404 len: 111 microversion: 2.1 time: 0.128784 Apr 13 18:07:03 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 309/918] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:07:03 2023] GET /compute/v2.1/servers/42e6a724-a30a-49db-8e06-fd1da3e57c6f => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:03 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:07:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88" status: 204 len: 0 microversion: 2.1 time: 0.206086 Apr 13 18:07:04 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 303/919] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:07:03 2023] DELETE /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:07:04 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:04 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:04 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:07:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-178f3944-2c4e-4114-9e18-ffb12343e4d7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88" status: 200 len: 1509 microversion: 2.1 time: 0.191882 Apr 13 18:07:04 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 308/920] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:07:04 2023] GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:07:04 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-unplugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:07:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:04 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] Creating event network-vif-unplugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 18:07:04 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028799 Apr 13 18:07:04 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 310/921] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:07:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:07:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-deleted", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:07:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] Creating event network-vif-deleted:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 18:07:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030183 Apr 13 18:07:05 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 304/922] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:07:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:07:06 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474af9f8-6700-4288-8133-a8dad4cf8a88", "name": "network-vif-plugged", "status": "completed", "tag": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:07:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:06 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] Creating event network-vif-plugged:bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance 474af9f8-6700-4288-8133-a8dad4cf8a88 on user Apr 13 18:07:06 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032438 Apr 13 18:07:06 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 309/923] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:07:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:24 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:07:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-965690d5-6720-4117-bd62-13a1f3c958d5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc" status: 200 len: 1545 microversion: 2.1 time: 0.181067 Apr 13 18:07:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 311/924] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:07:24 2023] GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc => generated 1545 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] HTTP exception thrown: Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 could not be found. Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Request method failure captured: Apr 13 18:07:33 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 HTTP/1.1 Apr 13 18:07:33 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:07:33 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:07:33 user devstack@n-api.service[61678]: Connection: close Apr 13 18:07:33 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:07:33 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:07:33 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:07:33 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:07:33 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEC0wT6gIjYgAp7ryxNvg1NUeKQIBpLErj5nTXZCM3BI9PipoXSi_Vegw9xPKGFCLIYyztmgn_sPNfICMspiOS6zck4j5uDZNQ13QTcsqvZbguyP2LS61i-jMinG0myKkkCMJ1RnadfeW6RaYpFjv6cocYaBjm_iumv0O7t3q84QxSU Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Project-Id: d533287b8269447aab81fa7d1312d3f1 Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Tenant-Id: d533287b8269447aab81fa7d1312d3f1 Apr 13 18:07:33 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:07:33 user devstack@n-api.service[61678]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member Apr 13 18:07:33 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:07:33 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:07:33 user devstack@n-api.service[61678]: X-User-Id: ec5fc9c7b7234904ba39d403764420b3 Apr 13 18:07:33 user devstack@n-api.service[61678]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member Apr 13 18:07:33 user devstack@n-api.service[61678]: method: > Apr 13 18:07:33 user devstack@n-api.service[61678]: exception: Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 could not be found. Apr 13 18:07:33 user devstack@n-api.service[61678]: action_args: {'id': 'f77e2740-4711-4a10-b099-0a8e5efdbb74'} Apr 13 18:07:33 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 could not be found. Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 could not be found. Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 could not be found. Apr 13 18:07:33 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Returning 404 to user: Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:07:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-3c35e69e-4dc1-4f9c-82fe-230ddfd87ead tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74" status: 404 len: 111 microversion: 2.87 time: 0.042759 Apr 13 18:07:33 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 305/925] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:07:33 2023] GET /compute/v2.1/servers/f77e2740-4711-4a10-b099-0a8e5efdbb74 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=17 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=22 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:33 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:07:33 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06" status: 204 len: 0 microversion: 2.87 time: 0.118994 Apr 13 18:07:33 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 310/926] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 18:07:33 2023] DELETE /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:07:33 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:07:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-b786d32e-9ca7-4982-90c8-2ebf9d165fda tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06" status: 200 len: 1697 microversion: 2.87 time: 0.206464 Apr 13 18:07:33 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 312/927] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:07:33 2023] GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06 => generated 1697 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561b1fe2-f0d2-4966-b449-4a139e570f06", "name": "network-vif-unplugged", "status": "completed", "tag": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:33 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] Creating event network-vif-unplugged:c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance 561b1fe2-f0d2-4966-b449-4a139e570f06 on user Apr 13 18:07:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029064 Apr 13 18:07:33 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 306/928] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:07:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:07:35 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:35 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561b1fe2-f0d2-4966-b449-4a139e570f06", "name": "network-vif-plugged", "status": "completed", "tag": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5"}, {"server_uuid": "561b1fe2-f0d2-4966-b449-4a139e570f06", "name": "network-vif-deleted", "tag": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:07:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] Creating event network-vif-plugged:c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance 561b1fe2-f0d2-4966-b449-4a139e570f06 on user Apr 13 18:07:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] Creating event network-vif-deleted:c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance 561b1fe2-f0d2-4966-b449-4a139e570f06 on user Apr 13 18:07:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032399 Apr 13 18:07:35 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 313/929] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:07:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:07:35 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:07:36 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-bf5affe1-e402-4c5a-94fb-3a0de033bce9 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3" status: 200 len: 1440 microversion: 2.1 time: 0.163315 Apr 13 18:07:36 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 311/930] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:07:35 2023] GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 => generated 1440 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:49 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:07:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5dc300fc-76c1-4852-b1e9-9706d9aebe3b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 200 len: 1547 microversion: 2.1 time: 0.277125 Apr 13 18:07:49 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 307/931] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:07:49 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 1547 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=14 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:49 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:49 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/action" status: 200 len: 28330 microversion: 2.1 time: 0.225208 Apr 13 18:07:49 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 314/932] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 18:07:49 2023] POST /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/action => generated 28330 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:49 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:50 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:07:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3e2a38eb-c99d-4a1f-ac30-48587aa599ed tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4" status: 200 len: 1540 microversion: 2.1 time: 0.152954 Apr 13 18:07:50 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 312/933] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:07:49 2023] GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4 => generated 1540 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:07:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] HTTP exception thrown: Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 could not be found. Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Request method failure captured: Apr 13 18:07:54 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 HTTP/1.1 Apr 13 18:07:54 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:07:54 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:07:54 user devstack@n-api.service[61678]: Connection: close Apr 13 18:07:54 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:07:54 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:07:54 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:07:54 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:07:54 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEDQnq4eQIZsnZOBn_j0_FU-f6LzfH5sy33GgC-hZqDIpXlV9V16O3ymT_4_jNnW8zh3Wer2j7e-5Vd1U0kX2BDIXPghI3-OHKVTmGKeSIMWv8bHIM3PWyuZyexyDKi3Zc4I686nabAZRhg5TYwZuKE4MHrKq5Bakp5f8QPHOtRfXWo Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Project-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c97ac3ae1ebe4107a05bd27710b9502b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Tenant: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Tenant-Id: c97ac3ae1ebe4107a05bd27710b9502b Apr 13 18:07:54 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-766015461 Apr 13 18:07:54 user devstack@n-api.service[61678]: X-User: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 18:07:54 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:07:54 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:07:54 user devstack@n-api.service[61678]: X-User-Id: 8f1fe2e6fd894d5c87d7ccf5fae553ca Apr 13 18:07:54 user devstack@n-api.service[61678]: X-User-Name: tempest-ServerRescueNegativeTestJSON-766015461-project-member Apr 13 18:07:54 user devstack@n-api.service[61678]: method: > Apr 13 18:07:54 user devstack@n-api.service[61678]: exception: Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 could not be found. Apr 13 18:07:54 user devstack@n-api.service[61678]: action_args: {'id': '474af9f8-6700-4288-8133-a8dad4cf8a88'} Apr 13 18:07:54 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 could not be found. Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 could not be found. Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 could not be found. Apr 13 18:07:54 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:07:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Returning 404 to user: Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:07:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-46c1b7d3-ba1d-4a4b-86bc-96b50ee0fa5c tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88" status: 404 len: 111 microversion: 2.1 time: 0.029918 Apr 13 18:07:54 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 308/934] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:07:54 2023] GET /compute/v2.1/servers/474af9f8-6700-4288-8133-a8dad4cf8a88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] HTTP exception thrown: Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 could not be found. Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Request method failure captured: Apr 13 18:08:23 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06 HTTP/1.1 Apr 13 18:08:23 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:08:23 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:08:23 user devstack@n-api.service[61676]: Connection: close Apr 13 18:08:23 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:08:23 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:08:23 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:08:23 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:08:23 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEC0wT6gIjYgAp7ryxNvg1NUeKQIBpLErj5nTXZCM3BI9PipoXSi_Vegw9xPKGFCLIYyztmgn_sPNfICMspiOS6zck4j5uDZNQ13QTcsqvZbguyP2LS61i-jMinG0myKkkCMJ1RnadfeW6RaYpFjv6cocYaBjm_iumv0O7t3q84QxSU Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Project-Id: d533287b8269447aab81fa7d1312d3f1 Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Tenant-Id: d533287b8269447aab81fa7d1312d3f1 Apr 13 18:08:23 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:08:23 user devstack@n-api.service[61676]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member Apr 13 18:08:23 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:08:23 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:08:23 user devstack@n-api.service[61676]: X-User-Id: ec5fc9c7b7234904ba39d403764420b3 Apr 13 18:08:23 user devstack@n-api.service[61676]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member Apr 13 18:08:23 user devstack@n-api.service[61676]: method: > Apr 13 18:08:23 user devstack@n-api.service[61676]: exception: Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 could not be found. Apr 13 18:08:23 user devstack@n-api.service[61676]: action_args: {'id': '561b1fe2-f0d2-4966-b449-4a139e570f06'} Apr 13 18:08:23 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 could not be found. Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 could not be found. Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 could not be found. Apr 13 18:08:23 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:08:23 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Returning 404 to user: Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:08:23 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-41c462c1-18a0-402b-99d5-13b3860b87a6 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06" status: 404 len: 111 microversion: 2.87 time: 0.051128 Apr 13 18:08:23 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 315/935] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:08:23 2023] GET /compute/v2.1/servers/561b1fe2-f0d2-4966-b449-4a139e570f06 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:08:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944" status: 204 len: 0 microversion: 2.87 time: 0.136925 Apr 13 18:08:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 313/936] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 18:08:23 2023] DELETE /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=8 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:08:24 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:08:24 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-268728c7-6add-4327-bd1c-515cfd6f8683 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944" status: 200 len: 1774 microversion: 2.87 time: 0.237055 Apr 13 18:08:24 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 309/937] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:08:24 2023] GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 => generated 1774 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:08:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-unplugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] Creating event network-vif-unplugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 18:08:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173929 Apr 13 18:08:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 316/938] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2d506f5f-1980-4447-ac92-da4d65bf0323 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2d506f5f-1980-4447-ac92-da4d65bf0323 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d506f5f-1980-4447-ac92-da4d65bf0323 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d506f5f-1980-4447-ac92-da4d65bf0323 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d506f5f-1980-4447-ac92-da4d65bf0323 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d506f5f-1980-4447-ac92-da4d65bf0323 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d506f5f-1980-4447-ac92-da4d65bf0323 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2d506f5f-1980-4447-ac92-da4d65bf0323 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2d506f5f-1980-4447-ac92-da4d65bf0323 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184849 Apr 13 18:08:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 314/939] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:08:24 2023] GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc/os-interface => generated 282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94db3503-3352-4326-b52a-f8af1061fafc", "tag": "aee67ff9-a673-4687-901d-66e22a39d83c"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] Creating event network-changed:aee67ff9-a673-4687-901d-66e22a39d83c for instance 94db3503-3352-4326-b52a-f8af1061fafc on user Apr 13 18:08:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032255 Apr 13 18:08:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 310/940] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-plugged", "status": "completed", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:26 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1a159c09-6ea2-4fd1-8421-afa45e74e05f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:26 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1a159c09-6ea2-4fd1-8421-afa45e74e05f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] Creating event network-vif-plugged:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 18:08:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a159c09-6ea2-4fd1-8421-afa45e74e05f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a159c09-6ea2-4fd1-8421-afa45e74e05f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a159c09-6ea2-4fd1-8421-afa45e74e05f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a159c09-6ea2-4fd1-8421-afa45e74e05f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a159c09-6ea2-4fd1-8421-afa45e74e05f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:26 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1a159c09-6ea2-4fd1-8421-afa45e74e05f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037879 Apr 13 18:08:26 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 317/941] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:26 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1a159c09-6ea2-4fd1-8421-afa45e74e05f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc/ips" status: 200 len: 108 microversion: 2.1 time: 0.045210 Apr 13 18:08:26 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 315/942] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 18:08:26 2023] GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc/ips => generated 108 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89cc9680-5d37-4798-a49f-0ff6e2466a65"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Invalid volume: volume 89cc9680-5d37-4798-a49f-0ff6e2466a65 is already attached to instances: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:08:26 user devstack@n-api.service[61678]: request: POST /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc/os-volume_attachments HTTP/1.1 Apr 13 18:08:26 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:08:26 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:08:26 user devstack@n-api.service[61678]: Connection: close Apr 13 18:08:26 user devstack@n-api.service[61678]: Content-Length: 74 Apr 13 18:08:26 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:08:26 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:08:26 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:08:26 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:08:26 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:08:26 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:08:26 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:08:26 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:08:26 user devstack@n-api.service[61678]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:08:26 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:08:26 user devstack@n-api.service[61678]: Apr 13 18:08:26 user devstack@n-api.service[61678]: {"volumeAttachment": {"volumeId": "89cc9680-5d37-4798-a49f-0ff6e2466a65"}} Apr 13 18:08:26 user devstack@n-api.service[61678]: method: > Apr 13 18:08:26 user devstack@n-api.service[61678]: exception: Invalid volume: volume 89cc9680-5d37-4798-a49f-0ff6e2466a65 is already attached to instances: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 Apr 13 18:08:26 user devstack@n-api.service[61678]: action_args: {'server_id': '94db3503-3352-4326-b52a-f8af1061fafc', 'body': {'volumeAttachment': {'volumeId': '89cc9680-5d37-4798-a49f-0ff6e2466a65'}}} Apr 13 18:08:26 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 89cc9680-5d37-4798-a49f-0ff6e2466a65 is already attached to instances: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 89cc9680-5d37-4798-a49f-0ff6e2466a65 is already attached to instances: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 89cc9680-5d37-4798-a49f-0ff6e2466a65 is already attached to instances: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 Apr 13 18:08:26 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:08:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 400 to user: Invalid volume: volume 89cc9680-5d37-4798-a49f-0ff6e2466a65 is already attached to instances: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:08:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f9312ed7-8d94-439d-827f-26cd5334579b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109613 Apr 13 18:08:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 311/943] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:08:26 2023] POST /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:26 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:08:27 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc" status: 204 len: 0 microversion: 2.1 time: 0.191624 Apr 13 18:08:27 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 318/944] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:08:26 2023] DELETE /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:08:27 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:27 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:27 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:27 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:08:27 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-b67c9a33-2f38-4fb8-b079-55d08058c537 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc" status: 200 len: 1551 microversion: 2.1 time: 0.210407 Apr 13 18:08:27 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 316/945] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:08:27 2023] GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc => generated 1551 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 18:08:28 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774abdc-69cc-4755-b62a-c74bc1997944", "name": "network-vif-deleted", "tag": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96"}, {"server_uuid": "94db3503-3352-4326-b52a-f8af1061fafc", "name": "network-vif-unplugged", "status": "completed", "tag": "aee67ff9-a673-4687-901d-66e22a39d83c"}, {"server_uuid": "94db3503-3352-4326-b52a-f8af1061fafc", "name": "network-vif-plugged", "status": "completed", "tag": "aee67ff9-a673-4687-901d-66e22a39d83c"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:28 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Creating event network-vif-deleted:9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance 1774abdc-69cc-4755-b62a-c74bc1997944 on user Apr 13 18:08:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Creating event network-vif-unplugged:aee67ff9-a673-4687-901d-66e22a39d83c for instance 94db3503-3352-4326-b52a-f8af1061fafc on user Apr 13 18:08:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Creating event network-vif-plugged:aee67ff9-a673-4687-901d-66e22a39d83c for instance 94db3503-3352-4326-b52a-f8af1061fafc on user Apr 13 18:08:28 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.042453 Apr 13 18:08:28 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 312/946] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:28 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-e3a996bf-e01d-44bb-a168-ad4a5e20beff req-c9f2ec8a-42ab-4376-9a61-4e8c352a07e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94db3503-3352-4326-b52a-f8af1061fafc", "name": "network-vif-deleted", "tag": "aee67ff9-a673-4687-901d-66e22a39d83c"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e3a996bf-e01d-44bb-a168-ad4a5e20beff req-c9f2ec8a-42ab-4376-9a61-4e8c352a07e4 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e3a996bf-e01d-44bb-a168-ad4a5e20beff req-c9f2ec8a-42ab-4376-9a61-4e8c352a07e4 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e3a996bf-e01d-44bb-a168-ad4a5e20beff req-c9f2ec8a-42ab-4376-9a61-4e8c352a07e4 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-e3a996bf-e01d-44bb-a168-ad4a5e20beff req-c9f2ec8a-42ab-4376-9a61-4e8c352a07e4 service nova] Creating event network-vif-deleted:aee67ff9-a673-4687-901d-66e22a39d83c for instance 94db3503-3352-4326-b52a-f8af1061fafc on user Apr 13 18:08:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-e3a996bf-e01d-44bb-a168-ad4a5e20beff req-c9f2ec8a-42ab-4376-9a61-4e8c352a07e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061238 Apr 13 18:08:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 319/947] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:36 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:36 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:36 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:08:36 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-93ed6484-d5a5-4d34-8d04-f614fb27e529 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3" status: 200 len: 1440 microversion: 2.1 time: 0.394324 Apr 13 18:08:36 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 317/948] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:08:36 2023] GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 => generated 1440 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:08:39 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5342d27-7121-489f-b1b7-c02d664e7fc3", "tag": "85b82f0f-9e05-4ff1-aec6-4530a2b04740"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:39 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=10 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:08:39 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=16 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:08:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] Creating event network-changed:85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance c5342d27-7121-489f-b1b7-c02d664e7fc3 on user Apr 13 18:08:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034883 Apr 13 18:08:39 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 313/949] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:40 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:40 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:08:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3" status: 204 len: 0 microversion: 2.1 time: 0.106300 Apr 13 18:08:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 320/950] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:08:40 2023] DELETE /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:08:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:40 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:08:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9287d145-12c6-4be1-9ab7-329d3e318de0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3" status: 200 len: 1565 microversion: 2.1 time: 0.216058 Apr 13 18:08:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 318/951] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:08:40 2023] GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 => generated 1565 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:08:41 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5342d27-7121-489f-b1b7-c02d664e7fc3", "name": "network-vif-unplugged", "status": "completed", "tag": "85b82f0f-9e05-4ff1-aec6-4530a2b04740"}, {"server_uuid": "c5342d27-7121-489f-b1b7-c02d664e7fc3", "name": "network-vif-plugged", "status": "completed", "tag": "85b82f0f-9e05-4ff1-aec6-4530a2b04740"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:41 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:41 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Creating event network-vif-unplugged:85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance c5342d27-7121-489f-b1b7-c02d664e7fc3 on user Apr 13 18:08:41 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Creating event network-vif-plugged:85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance c5342d27-7121-489f-b1b7-c02d664e7fc3 on user Apr 13 18:08:41 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029118 Apr 13 18:08:41 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 314/952] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:43 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-8f71c38d-aa4c-424d-af4d-91ea086919d5 req-ec30b9bb-a100-4bcb-b0db-9e08c13d0218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5342d27-7121-489f-b1b7-c02d664e7fc3", "name": "network-vif-deleted", "tag": "85b82f0f-9e05-4ff1-aec6-4530a2b04740"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8f71c38d-aa4c-424d-af4d-91ea086919d5 req-ec30b9bb-a100-4bcb-b0db-9e08c13d0218 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8f71c38d-aa4c-424d-af4d-91ea086919d5 req-ec30b9bb-a100-4bcb-b0db-9e08c13d0218 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:43 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8f71c38d-aa4c-424d-af4d-91ea086919d5 req-ec30b9bb-a100-4bcb-b0db-9e08c13d0218 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:43 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-8f71c38d-aa4c-424d-af4d-91ea086919d5 req-ec30b9bb-a100-4bcb-b0db-9e08c13d0218 service nova] Creating event network-vif-deleted:85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance c5342d27-7121-489f-b1b7-c02d664e7fc3 on user Apr 13 18:08:43 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-8f71c38d-aa4c-424d-af4d-91ea086919d5 req-ec30b9bb-a100-4bcb-b0db-9e08c13d0218 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033494 Apr 13 18:08:43 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 321/953] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:46 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8fa97066-bb59-4a13-96c5-0631bb543a19 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Action: 'create', calling method: .version_select at 0x7f82e22c9090>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-70279965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdDeKUtzSJspI72lbnknMzrtvKpB0VydInTJsCsqet7lYHxrl/btstctTwKJWV85y67b/TCTdh6M3eDr2mWkPKceN9b0PJAktNVaLOCELxlNW6m4q+2Lex6DrRkDZPllg=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:46 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-8fa97066-bb59-4a13-96c5-0631bb543a19 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Getting quotas for project 3d0b8c72627d48718f4d6657f0c220a3. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:08:46 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-8fa97066-bb59-4a13-96c5-0631bb543a19 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Getting quotas for user 414376a2c1204907aadfc83bbe3348e7 and project 3d0b8c72627d48718f4d6657f0c220a3. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:08:46 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8fa97066-bb59-4a13-96c5-0631bb543a19 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.286884 Apr 13 18:08:46 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 319/954] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:08:46 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-591177314", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-70279965", "security_groups": [{"name": "tempest-secgroup-smoke-1868482880"}], "networks": [{"uuid": "aa3bc514-e932-4cb2-bead-6d300a332487"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:47 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] validate_networks() for [('aa3bc514-e932-4cb2-bead-6d300a332487', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Getting quotas for project 3d0b8c72627d48718f4d6657f0c220a3. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Getting quotas for user 414376a2c1204907aadfc83bbe3348e7 and project 3d0b8c72627d48718f4d6657f0c220a3. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:08:48 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:08:48 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.577872 Apr 13 18:08:48 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 315/955] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:08:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:08:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-7ef5a914-2141-431c-ab19-c9b59297444d tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:48 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-7ef5a914-2141-431c-ab19-c9b59297444d tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:48 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-7ef5a914-2141-431c-ab19-c9b59297444d tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '414376a2c1204907aadfc83bbe3348e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0b8c72627d48718f4d6657f0c220a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:08:48 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-7ef5a914-2141-431c-ab19-c9b59297444d tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2" status: 200 len: 1254 microversion: 2.1 time: 0.075787 Apr 13 18:08:48 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 322/956] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:08:48 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2 => generated 1254 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:08:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 204 len: 0 microversion: 2.1 time: 0.223374 Apr 13 18:08:50 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 320/957] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:08:50 2023] DELETE /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:08:50 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:08:50 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:08:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:50 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:50 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:08:50 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-2bc8f907-41e6-40e0-a366-0371d1010518 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 200 len: 1553 microversion: 2.1 time: 0.203833 Apr 13 18:08:50 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 316/958] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:08:50 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:08:50 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e349b-11fe-47a6-b47e-e965774b00a2", "tag": "06a96589-5953-47a0-8e30-efd8d4dff9f3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:50 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "name": "network-vif-unplugged", "status": "completed", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:50 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] Creating event network-changed:06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 on user Apr 13 18:08:50 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032873 Apr 13 18:08:50 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 323/959] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] Creating event network-vif-unplugged:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:08:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043043 Apr 13 18:08:50 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 321/960] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:08:52 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e349b-11fe-47a6-b47e-e965774b00a2", "name": "network-vif-plugged", "status": "completed", "tag": "06a96589-5953-47a0-8e30-efd8d4dff9f3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] Creating event network-vif-plugged:06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 on user Apr 13 18:08:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038988 Apr 13 18:08:52 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 317/961] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:52 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-bf360209-270a-4b9c-8cc6-c961610c75cb req-6aab885f-c580-4576-96af-e13ee7f056ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "name": "network-vif-deleted", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-bf360209-270a-4b9c-8cc6-c961610c75cb req-6aab885f-c580-4576-96af-e13ee7f056ef service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-bf360209-270a-4b9c-8cc6-c961610c75cb req-6aab885f-c580-4576-96af-e13ee7f056ef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-bf360209-270a-4b9c-8cc6-c961610c75cb req-6aab885f-c580-4576-96af-e13ee7f056ef service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-bf360209-270a-4b9c-8cc6-c961610c75cb req-6aab885f-c580-4576-96af-e13ee7f056ef service nova] Creating event network-vif-deleted:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:08:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-bf360209-270a-4b9c-8cc6-c961610c75cb req-6aab885f-c580-4576-96af-e13ee7f056ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031084 Apr 13 18:08:52 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 324/962] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fb17e0-e220-4f95-ac74-70a3d90ecbec", "name": "network-vif-plugged", "status": "completed", "tag": "f0082b3f-a977-4bff-9b28-dc1618882e72"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] Creating event network-vif-plugged:f0082b3f-a977-4bff-9b28-dc1618882e72 for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec on user Apr 13 18:08:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046278 Apr 13 18:08:52 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 322/963] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:08:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e349b-11fe-47a6-b47e-e965774b00a2", "name": "network-vif-plugged", "status": "completed", "tag": "06a96589-5953-47a0-8e30-efd8d4dff9f3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:08:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:08:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:08:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:08:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] Creating event network-vif-plugged:06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 on user Apr 13 18:08:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028185 Apr 13 18:08:54 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 318/964] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:08:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] HTTP exception thrown: Instance 1774abdc-69cc-4755-b62a-c74bc1997944 could not be found. Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Request method failure captured: Apr 13 18:09:14 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 HTTP/1.1 Apr 13 18:09:14 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:09:14 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:09:14 user devstack@n-api.service[61676]: Connection: close Apr 13 18:09:14 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:09:14 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:09:14 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:09:14 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:09:14 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEC0wT6gIjYgAp7ryxNvg1NUeKQIBpLErj5nTXZCM3BI9PipoXSi_Vegw9xPKGFCLIYyztmgn_sPNfICMspiOS6zck4j5uDZNQ13QTcsqvZbguyP2LS61i-jMinG0myKkkCMJ1RnadfeW6RaYpFjv6cocYaBjm_iumv0O7t3q84QxSU Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Project-Id: d533287b8269447aab81fa7d1312d3f1 Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Tenant-Id: d533287b8269447aab81fa7d1312d3f1 Apr 13 18:09:14 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:09:14 user devstack@n-api.service[61676]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member Apr 13 18:09:14 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:09:14 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:09:14 user devstack@n-api.service[61676]: X-User-Id: ec5fc9c7b7234904ba39d403764420b3 Apr 13 18:09:14 user devstack@n-api.service[61676]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member Apr 13 18:09:14 user devstack@n-api.service[61676]: method: > Apr 13 18:09:14 user devstack@n-api.service[61676]: exception: Instance 1774abdc-69cc-4755-b62a-c74bc1997944 could not be found. Apr 13 18:09:14 user devstack@n-api.service[61676]: action_args: {'id': '1774abdc-69cc-4755-b62a-c74bc1997944'} Apr 13 18:09:14 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1774abdc-69cc-4755-b62a-c74bc1997944 could not be found. Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1774abdc-69cc-4755-b62a-c74bc1997944 could not be found. Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1774abdc-69cc-4755-b62a-c74bc1997944 could not be found. Apr 13 18:09:14 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Returning 404 to user: Instance 1774abdc-69cc-4755-b62a-c74bc1997944 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:09:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-95773873-db2d-42f9-af8d-50a9b9e960e9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944" status: 404 len: 111 microversion: 2.87 time: 0.039360 Apr 13 18:09:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 325/965] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:09:14 2023] GET /compute/v2.1/servers/1774abdc-69cc-4755-b62a-c74bc1997944 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:14 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:09:14 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb" status: 204 len: 0 microversion: 2.87 time: 0.131931 Apr 13 18:09:14 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 323/966] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 18:09:14 2023] DELETE /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=16 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:14 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:15 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:09:15 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:09:15 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:09:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ad8ca43f-acdf-4396-9ed9-a200ae3a82a2 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb" status: 200 len: 1696 microversion: 2.87 time: 0.242054 Apr 13 18:09:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 319/967] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:09:14 2023] GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:09:15 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0dac50-5f78-406c-bd56-3d7cdf43d1cb", "name": "network-vif-unplugged", "status": "completed", "tag": "ba1b3297-9105-4622-87e9-fdfa2daa7106"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:09:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] Creating event network-vif-unplugged:ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb on user Apr 13 18:09:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041559 Apr 13 18:09:15 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 326/968] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:09:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:09:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-120dca0f-35a0-4a44-80d4-bb55d49dc8aa req-3d09c770-a4e5-46d4-b29c-41c135c85ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0dac50-5f78-406c-bd56-3d7cdf43d1cb", "name": "network-vif-deleted", "tag": "ba1b3297-9105-4622-87e9-fdfa2daa7106"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:09:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-120dca0f-35a0-4a44-80d4-bb55d49dc8aa req-3d09c770-a4e5-46d4-b29c-41c135c85ba2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-120dca0f-35a0-4a44-80d4-bb55d49dc8aa req-3d09c770-a4e5-46d4-b29c-41c135c85ba2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-120dca0f-35a0-4a44-80d4-bb55d49dc8aa req-3d09c770-a4e5-46d4-b29c-41c135c85ba2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-120dca0f-35a0-4a44-80d4-bb55d49dc8aa req-3d09c770-a4e5-46d4-b29c-41c135c85ba2 service nova] Creating event network-vif-deleted:ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb on user Apr 13 18:09:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-120dca0f-35a0-4a44-80d4-bb55d49dc8aa req-3d09c770-a4e5-46d4-b29c-41c135c85ba2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028800 Apr 13 18:09:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 324/969] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:09:17 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0dac50-5f78-406c-bd56-3d7cdf43d1cb", "name": "network-vif-plugged", "status": "completed", "tag": "ba1b3297-9105-4622-87e9-fdfa2daa7106"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:09:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:17 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:17 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] Creating event network-vif-plugged:ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb on user Apr 13 18:09:17 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028043 Apr 13 18:09:17 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 320/970] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:09:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:17 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:09:17 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc HTTP/1.1 Apr 13 18:09:17 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:09:17 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:09:17 user devstack@n-api.service[61676]: Connection: close Apr 13 18:09:17 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:09:17 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:09:17 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:09:17 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:09:17 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:09:17 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:09:17 user devstack@n-api.service[61676]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:09:17 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:09:17 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:09:17 user devstack@n-api.service[61676]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:09:17 user devstack@n-api.service[61676]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:09:17 user devstack@n-api.service[61676]: method: > Apr 13 18:09:17 user devstack@n-api.service[61676]: exception: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:09:17 user devstack@n-api.service[61676]: action_args: {'id': '94db3503-3352-4326-b52a-f8af1061fafc'} Apr 13 18:09:17 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:09:17 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:17 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:09:17 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-6473b472-b338-44a9-b07d-9bc7521b56da tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc" status: 404 len: 111 microversion: 2.1 time: 0.028766 Apr 13 18:09:17 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 327/971] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:09:17 2023] GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:09:17 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-af6279c2-fc65-47d8-b88c-007c4c675045 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '.version_select at 0x7f82e22ca050>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:17 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-af6279c2-fc65-47d8-b88c-007c4c675045 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178076479" status: 202 len: 0 microversion: 2.1 time: 0.024833 Apr 13 18:09:17 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 325/972] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 18:09:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178076479 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:09:18 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:18 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:18 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:18 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'services' on Instance uuid 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:09:18 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-volume_attachments/89cc9680-5d37-4798-a49f-0ff6e2466a65" status: 202 len: 0 microversion: 2.1 time: 0.166107 Apr 13 18:09:18 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 321/973] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:09:18 2023] DELETE /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-volume_attachments/89cc9680-5d37-4798-a49f-0ff6e2466a65 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:09:18 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1baf7a1b-b9b7-4a7a-bc60-53aca0098f2a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:18 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1baf7a1b-b9b7-4a7a-bc60-53aca0098f2a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1baf7a1b-b9b7-4a7a-bc60-53aca0098f2a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1baf7a1b-b9b7-4a7a-bc60-53aca0098f2a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1baf7a1b-b9b7-4a7a-bc60-53aca0098f2a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1baf7a1b-b9b7-4a7a-bc60-53aca0098f2a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1baf7a1b-b9b7-4a7a-bc60-53aca0098f2a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:18 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1baf7a1b-b9b7-4a7a-bc60-53aca0098f2a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:18 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1baf7a1b-b9b7-4a7a-bc60-53aca0098f2a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 Apr 13 18:09:18 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 328/974] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:09:18 2023] GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:09:30 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 HTTP/1.1 Apr 13 18:09:30 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:09:30 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:09:30 user devstack@n-api.service[61677]: Connection: close Apr 13 18:09:30 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:09:30 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:09:30 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:09:30 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:09:30 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:09:30 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:09:30 user devstack@n-api.service[61677]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:09:30 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:09:30 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:09:30 user devstack@n-api.service[61677]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:09:30 user devstack@n-api.service[61677]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:09:30 user devstack@n-api.service[61677]: method: > Apr 13 18:09:30 user devstack@n-api.service[61677]: exception: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:09:30 user devstack@n-api.service[61677]: action_args: {'id': 'c5342d27-7121-489f-b1b7-c02d664e7fc3'} Apr 13 18:09:30 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:09:30 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:09:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-bbed9ed2-0572-4af8-88e5-489997a2ad41 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3" status: 404 len: 111 microversion: 2.1 time: 0.059572 Apr 13 18:09:30 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 326/975] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:09:30 2023] GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:09:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=8 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-15971703", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1422503133", "security_groups": [{"name": "tempest-secgroup-smoke-1400552645"}], "block_device_mapping_v2": [{"uuid": "329d61b0-027c-48c2-a0a1-0a93645302ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d901aa48-1af6-4ded-9c70-e270315524cc"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] validate_networks() for [('d901aa48-1af6-4ded-9c70-e270315524cc', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for user 1cd4d2b21dda452dab66c1973c3beec1 and project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:09:31 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='329d61b0-027c-48c2-a0a1-0a93645302ce',volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:09:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.029799 Apr 13 18:09:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 322/976] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:09:30 2023] POST /compute/v2.1/servers => generated 404 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:09:31 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-efeb12d2-3d68-45ae-b24a-60b148dcd3e1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:31 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-efeb12d2-3d68-45ae-b24a-60b148dcd3e1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:32 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:32 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=12 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:32 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-efeb12d2-3d68-45ae-b24a-60b148dcd3e1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:09:32 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-efeb12d2-3d68-45ae-b24a-60b148dcd3e1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518" status: 200 len: 1088 microversion: 2.1 time: 0.079241 Apr 13 18:09:32 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 329/977] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:09:31 2023] GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:09:34 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265cff53-3a62-456a-92fd-98025a195518", "tag": "eb4d0c83-d6e6-424e-a956-d52ece4d3228"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:09:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:34 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] Creating event network-changed:eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance 265cff53-3a62-456a-92fd-98025a195518 on user Apr 13 18:09:34 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031339 Apr 13 18:09:34 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 327/978] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:09:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:09:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:38 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:38 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '414376a2c1204907aadfc83bbe3348e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0b8c72627d48718f4d6657f0c220a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:09:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-27ac3d37-abc7-49ba-b7b5-7387efc9f6b2 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2" status: 200 len: 1567 microversion: 2.1 time: 0.143658 Apr 13 18:09:38 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 323/979] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:09:38 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265cff53-3a62-456a-92fd-98025a195518", "name": "network-vif-plugged", "status": "completed", "tag": "eb4d0c83-d6e6-424e-a956-d52ece4d3228"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] Creating event network-vif-plugged:eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance 265cff53-3a62-456a-92fd-98025a195518 on user Apr 13 18:09:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036805 Apr 13 18:09:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 330/980] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:09:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HTTP exception thrown: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Request method failure captured: Apr 13 18:09:40 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec HTTP/1.1 Apr 13 18:09:40 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:09:40 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:09:40 user devstack@n-api.service[61677]: Connection: close Apr 13 18:09:40 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:09:40 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:09:40 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:09:40 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:09:40 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_KuZSegvidCvRbvLaWYJtxrMth6brUAavIfruxyjoIdg_JGfICN_OYG4QHZhz3lkAlr0aaEzzkZsMRdGMC5NK-EdthloS_EdCdi9vddKhAWENSZQ8vvbTogFPMqE6u-5sy96xNBmFyoz5pySm6MuJZ5vvpuo1cg27qG46NmkzWnYs Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Project-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Project-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Tenant: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Tenant-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:09:40 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:09:40 user devstack@n-api.service[61677]: X-User: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:09:40 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:09:40 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:09:40 user devstack@n-api.service[61677]: X-User-Id: 8f796555c0e242d091502725ec595c0f Apr 13 18:09:40 user devstack@n-api.service[61677]: X-User-Name: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:09:40 user devstack@n-api.service[61677]: method: > Apr 13 18:09:40 user devstack@n-api.service[61677]: exception: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61677]: action_args: {'id': 'c4fb17e0-e220-4f95-ac74-70a3d90ecbec'} Apr 13 18:09:40 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Returning 404 to user: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:09:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-70dda2ed-8ee0-4066-be78-f176428c6068 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 404 len: 111 microversion: 2.1 time: 0.029460 Apr 13 18:09:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 328/981] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:09:40 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HTTP exception thrown: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Request method failure captured: Apr 13 18:09:40 user devstack@n-api.service[61678]: request: DELETE /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec HTTP/1.1 Apr 13 18:09:40 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:09:40 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:09:40 user devstack@n-api.service[61678]: Connection: close Apr 13 18:09:40 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:09:40 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:09:40 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:09:40 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:09:40 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_KuZSegvidCvRbvLaWYJtxrMth6brUAavIfruxyjoIdg_JGfICN_OYG4QHZhz3lkAlr0aaEzzkZsMRdGMC5NK-EdthloS_EdCdi9vddKhAWENSZQ8vvbTogFPMqE6u-5sy96xNBmFyoz5pySm6MuJZ5vvpuo1cg27qG46NmkzWnYs Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Project-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Project-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Tenant: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Tenant-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:09:40 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:09:40 user devstack@n-api.service[61678]: X-User: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:09:40 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:09:40 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:09:40 user devstack@n-api.service[61678]: X-User-Id: 8f796555c0e242d091502725ec595c0f Apr 13 18:09:40 user devstack@n-api.service[61678]: X-User-Name: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:09:40 user devstack@n-api.service[61678]: method: > Apr 13 18:09:40 user devstack@n-api.service[61678]: exception: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61678]: action_args: {'id': 'c4fb17e0-e220-4f95-ac74-70a3d90ecbec'} Apr 13 18:09:40 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Returning 404 to user: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:09:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-fef1e38c-aa06-4f2b-bd2a-09f96f39aee1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 404 len: 111 microversion: 2.1 time: 0.030542 Apr 13 18:09:40 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 324/982] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:09:40 2023] DELETE /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HTTP exception thrown: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Request method failure captured: Apr 13 18:09:40 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec HTTP/1.1 Apr 13 18:09:40 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:09:40 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:09:40 user devstack@n-api.service[61676]: Connection: close Apr 13 18:09:40 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:09:40 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:09:40 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:09:40 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:09:40 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_KuZSegvidCvRbvLaWYJtxrMth6brUAavIfruxyjoIdg_JGfICN_OYG4QHZhz3lkAlr0aaEzzkZsMRdGMC5NK-EdthloS_EdCdi9vddKhAWENSZQ8vvbTogFPMqE6u-5sy96xNBmFyoz5pySm6MuJZ5vvpuo1cg27qG46NmkzWnYs Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Project-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Project-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Tenant: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Tenant-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:09:40 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:09:40 user devstack@n-api.service[61676]: X-User: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:09:40 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:09:40 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:09:40 user devstack@n-api.service[61676]: X-User-Id: 8f796555c0e242d091502725ec595c0f Apr 13 18:09:40 user devstack@n-api.service[61676]: X-User-Name: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:09:40 user devstack@n-api.service[61676]: method: > Apr 13 18:09:40 user devstack@n-api.service[61676]: exception: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61676]: action_args: {'id': 'c4fb17e0-e220-4f95-ac74-70a3d90ecbec'} Apr 13 18:09:40 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. Apr 13 18:09:40 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:09:40 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Returning 404 to user: Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:09:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-88947b02-934a-47cb-a2f6-e88758ebf61e tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec" status: 404 len: 111 microversion: 2.1 time: 0.039660 Apr 13 18:09:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 331/983] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:09:40 2023] GET /compute/v2.1/servers/c4fb17e0-e220-4f95-ac74-70a3d90ecbec => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:09:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4" status: 204 len: 0 microversion: 2.1 time: 0.134197 Apr 13 18:09:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 329/984] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:09:40 2023] DELETE /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:41 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:09:41 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-73d4100e-0367-48a1-81dd-6464ec603cc6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4" status: 200 len: 1546 microversion: 2.1 time: 0.177003 Apr 13 18:09:41 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 325/985] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:09:40 2023] GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:09:41 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b75d41c6-6cf6-4162-b49b-c3205c128ef4", "name": "network-vif-unplugged", "status": "completed", "tag": "54109c72-9d87-44b7-a358-864c31b9c96d"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:09:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] Creating event network-vif-unplugged:54109c72-9d87-44b7-a358-864c31b9c96d for instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 on user Apr 13 18:09:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094634 Apr 13 18:09:41 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 332/986] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:09:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265cff53-3a62-456a-92fd-98025a195518", "name": "network-vif-plugged", "status": "completed", "tag": "eb4d0c83-d6e6-424e-a956-d52ece4d3228"}, {"server_uuid": "b75d41c6-6cf6-4162-b49b-c3205c128ef4", "name": "network-vif-deleted", "tag": "54109c72-9d87-44b7-a358-864c31b9c96d"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:09:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] Creating event network-vif-plugged:eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance 265cff53-3a62-456a-92fd-98025a195518 on user Apr 13 18:09:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] Creating event network-vif-deleted:54109c72-9d87-44b7-a358-864c31b9c96d for instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 on user Apr 13 18:09:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034870 Apr 13 18:09:42 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 330/987] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:09:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:09:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b75d41c6-6cf6-4162-b49b-c3205c128ef4", "name": "network-vif-plugged", "status": "completed", "tag": "54109c72-9d87-44b7-a358-864c31b9c96d"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:09:43 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:43 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:09:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:09:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:09:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:09:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] Creating event network-vif-plugged:54109c72-9d87-44b7-a358-864c31b9c96d for instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 on user Apr 13 18:09:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031944 Apr 13 18:09:43 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 326/988] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:09:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=10 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] HTTP exception thrown: Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb could not be found. Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Request method failure captured: Apr 13 18:10:05 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb HTTP/1.1 Apr 13 18:10:05 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:10:05 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:10:05 user devstack@n-api.service[61676]: Connection: close Apr 13 18:10:05 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:10:05 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:10:05 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:10:05 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:10:05 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEC0wT6gIjYgAp7ryxNvg1NUeKQIBpLErj5nTXZCM3BI9PipoXSi_Vegw9xPKGFCLIYyztmgn_sPNfICMspiOS6zck4j5uDZNQ13QTcsqvZbguyP2LS61i-jMinG0myKkkCMJ1RnadfeW6RaYpFjv6cocYaBjm_iumv0O7t3q84QxSU Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Project-Id: d533287b8269447aab81fa7d1312d3f1 Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d533287b8269447aab81fa7d1312d3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Tenant-Id: d533287b8269447aab81fa7d1312d3f1 Apr 13 18:10:05 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843 Apr 13 18:10:05 user devstack@n-api.service[61676]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member Apr 13 18:10:05 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:10:05 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:10:05 user devstack@n-api.service[61676]: X-User-Id: ec5fc9c7b7234904ba39d403764420b3 Apr 13 18:10:05 user devstack@n-api.service[61676]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member Apr 13 18:10:05 user devstack@n-api.service[61676]: method: > Apr 13 18:10:05 user devstack@n-api.service[61676]: exception: Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb could not be found. Apr 13 18:10:05 user devstack@n-api.service[61676]: action_args: {'id': 'db0dac50-5f78-406c-bd56-3d7cdf43d1cb'} Apr 13 18:10:05 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb could not be found. Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb could not be found. Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb could not be found. Apr 13 18:10:05 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:05 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Returning 404 to user: Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:10:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-6cd40044-3c97-4b19-b807-43acb2e13ad3 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb" status: 404 len: 111 microversion: 2.87 time: 0.034820 Apr 13 18:10:05 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 333/989] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:10:05 2023] GET /compute/v2.1/servers/db0dac50-5f78-406c-bd56-3d7cdf43d1cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-86849699-7fce-4378-93e4-4a618378546f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-86849699-7fce-4378-93e4-4a618378546f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-86849699-7fce-4378-93e4-4a618378546f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-86849699-7fce-4378-93e4-4a618378546f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-86849699-7fce-4378-93e4-4a618378546f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-86849699-7fce-4378-93e4-4a618378546f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-86849699-7fce-4378-93e4-4a618378546f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:08 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-86849699-7fce-4378-93e4-4a618378546f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:08 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-86849699-7fce-4378-93e4-4a618378546f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.252540 Apr 13 18:10:08 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 331/990] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:10:08 2023] GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/os-volume_attachments => generated 25 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=18 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:08 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:10:08 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5" status: 204 len: 0 microversion: 2.1 time: 0.121868 Apr 13 18:10:08 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 327/991] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:10:08 2023] DELETE /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:10:08 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:08 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:08 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:09 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:10:09 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-9b8fe319-48e3-4170-ad97-4da2902242bb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5" status: 200 len: 1670 microversion: 2.1 time: 0.242980 Apr 13 18:10:09 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 334/992] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:10:08 2023] GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 18:10:09 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b65bfd-ef04-44fc-b5bf-f4742705b8b5", "name": "network-vif-unplugged", "status": "completed", "tag": "e3e2fd87-b819-444d-afc1-f02005f3cedc"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:10:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:09 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:09 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] Creating event network-vif-unplugged:e3e2fd87-b819-444d-afc1-f02005f3cedc for instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 on user Apr 13 18:10:09 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033115 Apr 13 18:10:09 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 332/993] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:10:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:10 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b65bfd-ef04-44fc-b5bf-f4742705b8b5", "name": "network-vif-deleted", "tag": "e3e2fd87-b819-444d-afc1-f02005f3cedc"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:10:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:10 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:10 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] Creating event network-vif-deleted:e3e2fd87-b819-444d-afc1-f02005f3cedc for instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 on user Apr 13 18:10:10 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030672 Apr 13 18:10:10 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 328/994] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:10:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:10 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c3029346-1d5f-41ec-b3f6-882c0eb59ca2 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e2277e20>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:10 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c3029346-1d5f-41ec-b3f6-882c0eb59ca2 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5414e7db-8bf9-46f6-835d-186847f04168" status: 200 len: 350 microversion: 2.1 time: 0.050136 Apr 13 18:10:10 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 335/995] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:10:10 2023] GET /compute/v2.1/os-volumes/5414e7db-8bf9-46f6-835d-186847f04168 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:10:11 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b65bfd-ef04-44fc-b5bf-f4742705b8b5", "name": "network-vif-plugged", "status": "completed", "tag": "e3e2fd87-b819-444d-afc1-f02005f3cedc"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:10:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] Creating event network-vif-plugged:e3e2fd87-b819-444d-afc1-f02005f3cedc for instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 on user Apr 13 18:10:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031600 Apr 13 18:10:11 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 333/996] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:10:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9bdc0d75-d8e1-4062-8077-d1fb7a49adf1 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e2571bd0>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9bdc0d75-d8e1-4062-8077-d1fb7a49adf1 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ed711b68-efd2-4197-af54-3f93f5c6d833" status: 200 len: 351 microversion: 2.1 time: 0.054939 Apr 13 18:10:12 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 329/997] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:10:12 2023] GET /compute/v2.1/os-volumes/ed711b68-efd2-4197-af54-3f93f5c6d833 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:13 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-85fecdd5-fdfd-4109-88cd-53cbdb87c98b tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e2866320>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:13 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-85fecdd5-fdfd-4109-88cd-53cbdb87c98b tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/54b01610-6c8f-4024-8f25-98fa3652e62b" status: 200 len: 351 microversion: 2.1 time: 0.049838 Apr 13 18:10:13 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 336/998] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:10:13 2023] GET /compute/v2.1/os-volumes/54b01610-6c8f-4024-8f25-98fa3652e62b => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:13 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-6a1484e9-8c5b-41b2-bfdf-b65c08b390dc tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e22caa70>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-6a1484e9-8c5b-41b2-bfdf-b65c08b390dc tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.125397 Apr 13 18:10:13 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 334/999] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 18:10:13 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:10:13 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-27442714-bed6-4734-9d08-f82f5bc5e066 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e2383880>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-27442714-bed6-4734-9d08-f82f5bc5e066 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087556 Apr 13 18:10:13 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 330/1000] 10.0.0.210 () {62 vars in 1226 bytes} [Thu Apr 13 18:10:13 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:13 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e1485a6c-c039-4497-a02d-1a6d5ccc5125 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e27bd1b0>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-e1485a6c-c039-4497-a02d-1a6d5ccc5125 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094768 Apr 13 18:10:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 337/1001] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 18:10:13 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:10:14 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2afc1686-0d76-4011-8686-63de18441b48 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e23c8ca0>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:14 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2afc1686-0d76-4011-8686-63de18441b48 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101143 Apr 13 18:10:14 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 335/1002] 10.0.0.210 () {62 vars in 1244 bytes} [Thu Apr 13 18:10:14 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:14 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-e4b7c78b-aaf5-4a03-862e-6f8d8a5a9755 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e2571a20>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:14 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-e4b7c78b-aaf5-4a03-862e-6f8d8a5a9755 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.179751 Apr 13 18:10:14 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 331/1003] 10.0.0.210 () {62 vars in 1247 bytes} [Thu Apr 13 18:10:14 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1c49b0cb-0cc4-4ba8-9d9e-fe8856ae9150 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e2276b00>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1c49b0cb-0cc4-4ba8-9d9e-fe8856ae9150 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084735 Apr 13 18:10:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 338/1004] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 18:10:14 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:10:14 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a8229766-f0b6-451f-9c82-f48d0fb0ff42 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e22c8670>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:14 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a8229766-f0b6-451f-9c82-f48d0fb0ff42 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085700 Apr 13 18:10:14 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 336/1005] 10.0.0.210 () {62 vars in 1265 bytes} [Thu Apr 13 18:10:14 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:14 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-66f60294-a0db-4ad0-8728-55eeaf521602 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] Calling method '.version_select at 0x7f82e2425000>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:14 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-66f60294-a0db-4ad0-8728-55eeaf521602 tempest-VolumesTestJSON-1046569090 tempest-VolumesTestJSON-1046569090-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095357 Apr 13 18:10:14 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 332/1006] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 18:10:14 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:22 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:10:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-c7dcacdf-a42d-4407-9d88-1c11fc0e7c6e tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518" status: 200 len: 1440 microversion: 2.1 time: 0.208589 Apr 13 18:10:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 339/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:10:22 2023] GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518 => generated 1440 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HTTP exception thrown: Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 could not be found. Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Request method failure captured: Apr 13 18:10:31 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4 HTTP/1.1 Apr 13 18:10:31 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:10:31 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:10:31 user devstack@n-api.service[61677]: Connection: close Apr 13 18:10:31 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:10:31 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:10:31 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:10:31 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:10:31 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOD_KuZSegvidCvRbvLaWYJtxrMth6brUAavIfruxyjoIdg_JGfICN_OYG4QHZhz3lkAlr0aaEzzkZsMRdGMC5NK-EdthloS_EdCdi9vddKhAWENSZQ8vvbTogFPMqE6u-5sy96xNBmFyoz5pySm6MuJZ5vvpuo1cg27qG46NmkzWnYs Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Project-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Project-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Tenant: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Tenant-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:10:31 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:10:31 user devstack@n-api.service[61677]: X-User: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:10:31 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:10:31 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:10:31 user devstack@n-api.service[61677]: X-User-Id: 8f796555c0e242d091502725ec595c0f Apr 13 18:10:31 user devstack@n-api.service[61677]: X-User-Name: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:10:31 user devstack@n-api.service[61677]: method: > Apr 13 18:10:31 user devstack@n-api.service[61677]: exception: Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 could not be found. Apr 13 18:10:31 user devstack@n-api.service[61677]: action_args: {'id': 'b75d41c6-6cf6-4162-b49b-c3205c128ef4'} Apr 13 18:10:31 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 could not be found. Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 could not be found. Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 could not be found. Apr 13 18:10:31 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:10:31 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Returning 404 to user: Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:10:31 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-78de93db-3e7b-41bd-9f00-9cdd18a14c22 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4" status: 404 len: 111 microversion: 2.1 time: 0.041495 Apr 13 18:10:31 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 337/1008] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:10:31 2023] GET /compute/v2.1/servers/b75d41c6-6cf6-4162-b49b-c3205c128ef4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HTTP exception thrown: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Request method failure captured: Apr 13 18:10:35 user devstack@n-api.service[61678]: request: DELETE /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 HTTP/1.1 Apr 13 18:10:35 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:10:35 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:10:35 user devstack@n-api.service[61678]: Connection: close Apr 13 18:10:35 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:10:35 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:10:35 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:10:35 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:10:35 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOD_KuZSegvidCvRbvLaWYJtxrMth6brUAavIfruxyjoIdg_JGfICN_OYG4QHZhz3lkAlr0aaEzzkZsMRdGMC5NK-EdthloS_EdCdi9vddKhAWENSZQ8vvbTogFPMqE6u-5sy96xNBmFyoz5pySm6MuJZ5vvpuo1cg27qG46NmkzWnYs Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Project-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Project-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Tenant: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Tenant-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:10:35 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:10:35 user devstack@n-api.service[61678]: X-User: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:10:35 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:10:35 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:10:35 user devstack@n-api.service[61678]: X-User-Id: 8f796555c0e242d091502725ec595c0f Apr 13 18:10:35 user devstack@n-api.service[61678]: X-User-Name: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:10:35 user devstack@n-api.service[61678]: method: > Apr 13 18:10:35 user devstack@n-api.service[61678]: exception: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61678]: action_args: {'id': '08984ef0-6db9-4a60-b5b9-a6325ec531b1'} Apr 13 18:10:35 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Returning 404 to user: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:10:35 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f7b501b0-fef3-4cb3-bb4a-27dc4ae29f0a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 404 len: 111 microversion: 2.1 time: 0.048062 Apr 13 18:10:35 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 333/1009] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:10:35 2023] DELETE /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HTTP exception thrown: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Request method failure captured: Apr 13 18:10:35 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 HTTP/1.1 Apr 13 18:10:35 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:10:35 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:10:35 user devstack@n-api.service[61676]: Connection: close Apr 13 18:10:35 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:10:35 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:10:35 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:10:35 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:10:35 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOD_KuZSegvidCvRbvLaWYJtxrMth6brUAavIfruxyjoIdg_JGfICN_OYG4QHZhz3lkAlr0aaEzzkZsMRdGMC5NK-EdthloS_EdCdi9vddKhAWENSZQ8vvbTogFPMqE6u-5sy96xNBmFyoz5pySm6MuJZ5vvpuo1cg27qG46NmkzWnYs Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Project-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Project-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71e743d5e6104b55b57b4754fe7e668a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Tenant: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Tenant-Id: 71e743d5e6104b55b57b4754fe7e668a Apr 13 18:10:35 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-ServerActionsTestJSON-1530883669 Apr 13 18:10:35 user devstack@n-api.service[61676]: X-User: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:10:35 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:10:35 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:10:35 user devstack@n-api.service[61676]: X-User-Id: 8f796555c0e242d091502725ec595c0f Apr 13 18:10:35 user devstack@n-api.service[61676]: X-User-Name: tempest-ServerActionsTestJSON-1530883669-project-member Apr 13 18:10:35 user devstack@n-api.service[61676]: method: > Apr 13 18:10:35 user devstack@n-api.service[61676]: exception: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61676]: action_args: {'id': '08984ef0-6db9-4a60-b5b9-a6325ec531b1'} Apr 13 18:10:35 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. Apr 13 18:10:35 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:10:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Returning 404 to user: Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:10:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-18c58222-ee67-42d0-8b38-dedd20e43433 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1" status: 404 len: 111 microversion: 2.1 time: 0.032120 Apr 13 18:10:35 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 340/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:10:35 2023] GET /compute/v2.1/servers/08984ef0-6db9-4a60-b5b9-a6325ec531b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:10:35 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3fc781f5-298a-4cec-a373-d13a2c303c53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Calling method '.version_select at 0x7f82e22c9120>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3fc781f5-298a-4cec-a373-d13a2c303c53 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272899020" status: 202 len: 0 microversion: 2.1 time: 0.026884 Apr 13 18:10:35 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 338/1011] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 18:10:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272899020 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:10:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:38 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:38 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '414376a2c1204907aadfc83bbe3348e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0b8c72627d48718f4d6657f0c220a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:10:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-d900ed25-498f-4409-bbdd-2253be7681ce tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2" status: 200 len: 1567 microversion: 2.1 time: 0.183106 Apr 13 18:10:38 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 334/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:10:38 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:10:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e349b-11fe-47a6-b47e-e965774b00a2", "tag": "06a96589-5953-47a0-8e30-efd8d4dff9f3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:10:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] Creating event network-changed:06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 on user Apr 13 18:10:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030348 Apr 13 18:10:42 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 341/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:10:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:42 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13f2fc2e-83cf-4e78-bfdb-e58d09857b58"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:10:42 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:42 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306525 Apr 13 18:10:42 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 339/1014] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:10:42 2023] POST /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=8 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:10:59 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:10:59 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 HTTP/1.1 Apr 13 18:10:59 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:10:59 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:10:59 user devstack@n-api.service[61678]: Connection: close Apr 13 18:10:59 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:10:59 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:10:59 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:10:59 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:10:59 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:10:59 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:10:59 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:10:59 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:10:59 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:10:59 user devstack@n-api.service[61678]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:10:59 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:10:59 user devstack@n-api.service[61678]: method: > Apr 13 18:10:59 user devstack@n-api.service[61678]: exception: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:10:59 user devstack@n-api.service[61678]: action_args: {'id': '19b65bfd-ef04-44fc-b5bf-f4742705b8b5'} Apr 13 18:10:59 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:10:59 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:10:59 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:10:59 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f9d4554c-be2b-4001-a0df-76af4478960a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5" status: 404 len: 111 microversion: 2.1 time: 0.036139 Apr 13 18:10:59 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 335/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:10:59 2023] GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:10:59 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:59 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:10:59 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0de4dc93-ca1e-4151-a5eb-0d37596028f8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '.version_select at 0x7f82e22760e0>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:10:59 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0de4dc93-ca1e-4151-a5eb-0d37596028f8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-577728192" status: 202 len: 0 microversion: 2.1 time: 0.060544 Apr 13 18:10:59 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 342/1016] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 18:10:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-577728192 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:11:00 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:00 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:00 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a266caab-6122-488d-9d1d-80cae9989165 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: .version_select at 0x7f82e23ca710>, body: {"keypair": {"name": "tempest-keypair-1291612920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYxg2XyF7Adew+qh4/sZlHk9cfH5MC0/RGhywZ7WdUIWZ70Ee4BBYdRrK50BUnnUDE6EVAThjcmXg8SHgoZWM22UZrP+EyGmlzYkuUKI2lw7JBwCLxeWg66VmuLKH+WFw=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:00 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-a266caab-6122-488d-9d1d-80cae9989165 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:11:00 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-a266caab-6122-488d-9d1d-80cae9989165 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for user 0ac81be2a2db40b2acbae911db8086ca and project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:11:00 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a266caab-6122-488d-9d1d-80cae9989165 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100343 Apr 13 18:11:00 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 340/1017] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:11:00 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:01 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:11:01 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:11:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:01 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:01 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'services' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:11:01 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments/13f2fc2e-83cf-4e78-bfdb-e58d09857b58" status: 202 len: 0 microversion: 2.1 time: 0.322142 Apr 13 18:11:01 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 336/1018] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:11:01 2023] DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments/13f2fc2e-83cf-4e78-bfdb-e58d09857b58 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:11:01 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-90b2a29b-4e4f-412a-9cc2-b33d33ac1329 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:11:01 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-90b2a29b-4e4f-412a-9cc2-b33d33ac1329 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:11:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90b2a29b-4e4f-412a-9cc2-b33d33ac1329 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90b2a29b-4e4f-412a-9cc2-b33d33ac1329 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90b2a29b-4e4f-412a-9cc2-b33d33ac1329 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90b2a29b-4e4f-412a-9cc2-b33d33ac1329 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90b2a29b-4e4f-412a-9cc2-b33d33ac1329 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-90b2a29b-4e4f-412a-9cc2-b33d33ac1329 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:01 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-90b2a29b-4e4f-412a-9cc2-b33d33ac1329 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076172 Apr 13 18:11:01 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 343/1019] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:11:01 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:01 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-773936371", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "182886ee-6e1e-4146-903d-955b8b6726f4"}], "security_groups": [{"name": "tempest-securitygroup--225381995"}], "key_name": "tempest-keypair-1291612920", "user_data": "}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:01 user devstack@n-api.service[61677]: DEBUG nova.network.neutron [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] validate_networks() for [('182886ee-6e1e-4146-903d-955b8b6726f4', None, None, None, None, None)] {{(pid=61677) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image limits 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image pref 0:0:0 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for user 0ac81be2a2db40b2acbae911db8086ca and project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'instances', 'ram', 'cores'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Going to run 1 instances... {{(pid=61677) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:11:02 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:11:02 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.742347 Apr 13 18:11:02 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 341/1020] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:11:01 2023] POST /compute/v2.1/servers => generated 399 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:11:02 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7cebcfd4-e387-4ffd-91e0-957c1709c5e5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:11:02 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7cebcfd4-e387-4ffd-91e0-957c1709c5e5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:11:02 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-7cebcfd4-e387-4ffd-91e0-957c1709c5e5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:11:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7cebcfd4-e387-4ffd-91e0-957c1709c5e5 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81" status: 200 len: 1235 microversion: 2.1 time: 0.080928 Apr 13 18:11:02 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 337/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:11:02 2023] GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => generated 1235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:11:05 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726eed4a-ac9c-4cef-aa8a-2600b26c1f81", "tag": "1e990464-f0e7-451e-9833-ca1c228c892a"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:05 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] Creating event network-changed:1e990464-f0e7-451e-9833-ca1c228c892a for instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 on user Apr 13 18:11:05 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033104 Apr 13 18:11:05 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 344/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:07 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726eed4a-ac9c-4cef-aa8a-2600b26c1f81", "name": "network-vif-plugged", "status": "completed", "tag": "1e990464-f0e7-451e-9833-ca1c228c892a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:07 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:07 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] Creating event network-vif-plugged:1e990464-f0e7-451e-9833-ca1c228c892a for instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 on user Apr 13 18:11:07 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035670 Apr 13 18:11:07 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 342/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:09 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726eed4a-ac9c-4cef-aa8a-2600b26c1f81", "name": "network-vif-plugged", "status": "completed", "tag": "1e990464-f0e7-451e-9833-ca1c228c892a"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:09 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] Creating event network-vif-plugged:1e990464-f0e7-451e-9833-ca1c228c892a for instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 on user Apr 13 18:11:09 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031040 Apr 13 18:11:09 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 338/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:22 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:11:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-42b6134a-19bd-461d-8918-ca2887c2ebdb tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518" status: 200 len: 1440 microversion: 2.1 time: 0.166996 Apr 13 18:11:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 345/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:11:22 2023] GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518 => generated 1440 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:11:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265cff53-3a62-456a-92fd-98025a195518", "tag": "eb4d0c83-d6e6-424e-a956-d52ece4d3228"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:24 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:24 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:24 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:24 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] Creating event network-changed:eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance 265cff53-3a62-456a-92fd-98025a195518 on user Apr 13 18:11:24 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044784 Apr 13 18:11:24 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 343/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=10 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:30 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:30 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1973954414", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1422503133", "security_groups": [{"name": "tempest-secgroup-smoke-1400552645"}], "block_device_mapping_v2": [{"uuid": "042b8df2-6b74-4c93-ba2b-2de2831316d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d901aa48-1af6-4ded-9c70-e270315524cc"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:30 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] validate_networks() for [('d901aa48-1af6-4ded-9c70-e270315524cc', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting quotas for user 1cd4d2b21dda452dab66c1973c3beec1 and project 25f789d52faa469c802d7c1281ed8c82. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:11:31 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='042b8df2-6b74-4c93-ba2b-2de2831316d4',volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:11:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.106841 Apr 13 18:11:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 339/1027] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:11:30 2023] POST /compute/v2.1/servers => generated 404 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:11:31 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-deb48250-ea06-4b90-a3df-c9f8c076fee0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:11:31 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-deb48250-ea06-4b90-a3df-c9f8c076fee0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:11:31 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-deb48250-ea06-4b90-a3df-c9f8c076fee0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:11:31 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-deb48250-ea06-4b90-a3df-c9f8c076fee0 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd" status: 200 len: 1090 microversion: 2.1 time: 0.067274 Apr 13 18:11:31 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 346/1028] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:11:31 2023] GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd => generated 1090 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:11:34 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:34 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:34 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d350bf71-885d-4f3e-acdc-0136ab1469bd", "tag": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:35 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] Creating event network-changed:ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance d350bf71-885d-4f3e-acdc-0136ab1469bd on user Apr 13 18:11:35 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036838 Apr 13 18:11:35 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 344/1029] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1211956599", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "8c0bb9a4-c569-427c-b647-0edba62c1127"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] validate_networks() for [('8c0bb9a4-c569-427c-b647-0edba62c1127', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Getting quotas for project 062033ffc6ac4a03964b7ed0bd1f2410. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Getting quotas for user a8f752d2c4bf47c182cba7daeb460924 and project 062033ffc6ac4a03964b7ed0bd1f2410. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:11:39 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:11:39 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.470833 Apr 13 18:11:39 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 340/1030] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:11:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:11:39 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0e2f1bf5-b275-42a5-8cb1-36267e2b7bdd tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:11:39 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0e2f1bf5-b275-42a5-8cb1-36267e2b7bdd tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:11:39 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:40 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-0e2f1bf5-b275-42a5-8cb1-36267e2b7bdd tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f752d2c4bf47c182cba7daeb460924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062033ffc6ac4a03964b7ed0bd1f2410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:11:40 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0e2f1bf5-b275-42a5-8cb1-36267e2b7bdd tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3" status: 200 len: 1208 microversion: 2.1 time: 0.176494 Apr 13 18:11:40 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 347/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:11:39 2023] GET /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3 => generated 1208 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:11:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d350bf71-885d-4f3e-acdc-0136ab1469bd", "name": "network-vif-plugged", "status": "completed", "tag": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] Creating event network-vif-plugged:ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance d350bf71-885d-4f3e-acdc-0136ab1469bd on user Apr 13 18:11:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041875 Apr 13 18:11:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 345/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f782ce-3912-43ff-b74c-dd645c3a4fe3", "tag": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] Creating event network-changed:bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 on user Apr 13 18:11:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086998 Apr 13 18:11:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 341/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d350bf71-885d-4f3e-acdc-0136ab1469bd", "name": "network-vif-plugged", "status": "completed", "tag": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] Creating event network-vif-plugged:ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance d350bf71-885d-4f3e-acdc-0136ab1469bd on user Apr 13 18:11:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031732 Apr 13 18:11:42 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 348/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:44 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f782ce-3912-43ff-b74c-dd645c3a4fe3", "name": "network-vif-plugged", "status": "completed", "tag": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] Creating event network-vif-plugged:bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 on user Apr 13 18:11:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032125 Apr 13 18:11:44 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 346/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:11:46 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f782ce-3912-43ff-b74c-dd645c3a4fe3", "name": "network-vif-plugged", "status": "completed", "tag": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:46 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] Creating event network-vif-plugged:bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 on user Apr 13 18:11:46 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031540 Apr 13 18:11:46 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 342/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:11:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:11:51 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:51 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-bd30364a-e940-4476-88a2-f2ed7bfe4259 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:11:51 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-bd30364a-e940-4476-88a2-f2ed7bfe4259 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:11:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bd30364a-e940-4476-88a2-f2ed7bfe4259 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bd30364a-e940-4476-88a2-f2ed7bfe4259 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bd30364a-e940-4476-88a2-f2ed7bfe4259 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bd30364a-e940-4476-88a2-f2ed7bfe4259 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bd30364a-e940-4476-88a2-f2ed7bfe4259 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bd30364a-e940-4476-88a2-f2ed7bfe4259 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:51 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-bd30364a-e940-4476-88a2-f2ed7bfe4259 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042767 Apr 13 18:11:51 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 349/1037] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:11:51 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:11:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:11:52 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:11:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:52 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:11:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-61e4edcc-e456-466c-a41e-ed71dd3c517f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81" status: 200 len: 1544 microversion: 2.1 time: 0.256805 Apr 13 18:11:52 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 347/1038] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:11:52 2023] GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=12 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "628b9310-96f4-440c-9852-962d99e7a2bd"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:11:54 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:11:54 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268254 Apr 13 18:11:54 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 343/1039] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:11:54 2023] POST /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:12:01 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:12:01 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:12:01 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=14 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:01 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:02 user devstack@n-api.service[61676]: DEBUG nova.objects.instance [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'services' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=61676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:12:02 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments/628b9310-96f4-440c-9852-962d99e7a2bd" status: 202 len: 0 microversion: 2.1 time: 0.179275 Apr 13 18:12:02 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 350/1040] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:12:01 2023] DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments/628b9310-96f4-440c-9852-962d99e7a2bd => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:12:02 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-07b27f4f-6c24-45a2-963f-db7d613c1a16 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:12:02 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-07b27f4f-6c24-45a2-963f-db7d613c1a16 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:12:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-07b27f4f-6c24-45a2-963f-db7d613c1a16 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-07b27f4f-6c24-45a2-963f-db7d613c1a16 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-07b27f4f-6c24-45a2-963f-db7d613c1a16 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-07b27f4f-6c24-45a2-963f-db7d613c1a16 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-07b27f4f-6c24-45a2-963f-db7d613c1a16 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-07b27f4f-6c24-45a2-963f-db7d613c1a16 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:02 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-07b27f4f-6c24-45a2-963f-db7d613c1a16 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051949 Apr 13 18:12:02 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 348/1041] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:12:02 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:22 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:12:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-f609c716-1f31-4486-8739-0f7bb357df67 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd" status: 200 len: 1442 microversion: 2.1 time: 0.164331 Apr 13 18:12:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 344/1042] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:12:21 2023] GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:30 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f752d2c4bf47c182cba7daeb460924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062033ffc6ac4a03964b7ed0bd1f2410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:12:30 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2b527d69-fdb9-4a8e-ba64-5edb5fb5b51d tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3" status: 200 len: 1486 microversion: 2.1 time: 0.164311 Apr 13 18:12:30 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 351/1043] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:12:30 2023] GET /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3 => generated 1486 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-52d4cca0-529a-431b-8f84-d587d7182cca tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-52d4cca0-529a-431b-8f84-d587d7182cca tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=18 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-52d4cca0-529a-431b-8f84-d587d7182cca tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-52d4cca0-529a-431b-8f84-d587d7182cca tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-52d4cca0-529a-431b-8f84-d587d7182cca tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-52d4cca0-529a-431b-8f84-d587d7182cca tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-52d4cca0-529a-431b-8f84-d587d7182cca tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-52d4cca0-529a-431b-8f84-d587d7182cca tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-52d4cca0-529a-431b-8f84-d587d7182cca tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053559 Apr 13 18:12:52 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 349/1044] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:12:52 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-fce71deb-da9b-4fab-946b-d04e62e7cac9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-fce71deb-da9b-4fab-946b-d04e62e7cac9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fce71deb-da9b-4fab-946b-d04e62e7cac9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fce71deb-da9b-4fab-946b-d04e62e7cac9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fce71deb-da9b-4fab-946b-d04e62e7cac9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fce71deb-da9b-4fab-946b-d04e62e7cac9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fce71deb-da9b-4fab-946b-d04e62e7cac9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-fce71deb-da9b-4fab-946b-d04e62e7cac9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:53 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-fce71deb-da9b-4fab-946b-d04e62e7cac9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.159029 Apr 13 18:12:53 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 345/1045] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:12:53 2023] GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-interface => generated 282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:12:53 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726eed4a-ac9c-4cef-aa8a-2600b26c1f81", "tag": "1e990464-f0e7-451e-9833-ca1c228c892a"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:12:53 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:53 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:12:53 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:53 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:53 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] Creating event network-changed:1e990464-f0e7-451e-9833-ca1c228c892a for instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 on user Apr 13 18:12:53 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038295 Apr 13 18:12:53 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 352/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:12:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:12:53 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-f0cb63a7-862a-4172-9be9-eb24927a2c10 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:12:53 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-f0cb63a7-862a-4172-9be9-eb24927a2c10 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:12:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f0cb63a7-862a-4172-9be9-eb24927a2c10 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f0cb63a7-862a-4172-9be9-eb24927a2c10 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f0cb63a7-862a-4172-9be9-eb24927a2c10 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f0cb63a7-862a-4172-9be9-eb24927a2c10 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f0cb63a7-862a-4172-9be9-eb24927a2c10 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-f0cb63a7-862a-4172-9be9-eb24927a2c10 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-f0cb63a7-862a-4172-9be9-eb24927a2c10 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/ips" status: 200 len: 108 microversion: 2.1 time: 0.042352 Apr 13 18:12:54 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 350/1047] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 18:12:53 2023] GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/ips => generated 108 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:12:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:12:55 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:12:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286144 Apr 13 18:12:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 346/1048] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:12:54 2023] POST /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:12:55 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09e00e3b-ca43-4ab9-83c9-c665144d06c8"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:12:55 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:12:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:12:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:12:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:12:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318892 Apr 13 18:12:55 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 353/1049] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:12:55 2023] POST /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:03 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:03 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'services' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:13:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments/8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5" status: 202 len: 0 microversion: 2.1 time: 0.169015 Apr 13 18:13:03 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 351/1050] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:13:03 2023] DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments/8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:13:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-300e229c-3fa7-4815-a5dd-e4f38622b7f0 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:03 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-300e229c-3fa7-4815-a5dd-e4f38622b7f0 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-300e229c-3fa7-4815-a5dd-e4f38622b7f0 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-300e229c-3fa7-4815-a5dd-e4f38622b7f0 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-300e229c-3fa7-4815-a5dd-e4f38622b7f0 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-300e229c-3fa7-4815-a5dd-e4f38622b7f0 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-300e229c-3fa7-4815-a5dd-e4f38622b7f0 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-300e229c-3fa7-4815-a5dd-e4f38622b7f0 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-300e229c-3fa7-4815-a5dd-e4f38622b7f0 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045513 Apr 13 18:13:03 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 347/1051] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:13:03 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09e00e3b-ca43-4ab9-83c9-c665144d06c8"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:04 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Invalid volume: volume 09e00e3b-ca43-4ab9-83c9-c665144d06c8 is already attached to instances: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:13:04 user devstack@n-api.service[61676]: request: POST /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments HTTP/1.1 Apr 13 18:13:04 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:13:04 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:13:04 user devstack@n-api.service[61676]: Connection: close Apr 13 18:13:04 user devstack@n-api.service[61676]: Content-Length: 74 Apr 13 18:13:04 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:13:04 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:13:04 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:13:04 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:13:04 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:13:04 user devstack@n-api.service[61676]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:13:04 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:13:04 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:13:04 user devstack@n-api.service[61676]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:13:04 user devstack@n-api.service[61676]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:13:04 user devstack@n-api.service[61676]: Apr 13 18:13:04 user devstack@n-api.service[61676]: {"volumeAttachment": {"volumeId": "09e00e3b-ca43-4ab9-83c9-c665144d06c8"}} Apr 13 18:13:04 user devstack@n-api.service[61676]: method: > Apr 13 18:13:04 user devstack@n-api.service[61676]: exception: Invalid volume: volume 09e00e3b-ca43-4ab9-83c9-c665144d06c8 is already attached to instances: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 Apr 13 18:13:04 user devstack@n-api.service[61676]: action_args: {'server_id': '726eed4a-ac9c-4cef-aa8a-2600b26c1f81', 'body': {'volumeAttachment': {'volumeId': '09e00e3b-ca43-4ab9-83c9-c665144d06c8'}}} Apr 13 18:13:04 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 09e00e3b-ca43-4ab9-83c9-c665144d06c8 is already attached to instances: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 09e00e3b-ca43-4ab9-83c9-c665144d06c8 is already attached to instances: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 09e00e3b-ca43-4ab9-83c9-c665144d06c8 is already attached to instances: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 Apr 13 18:13:04 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:13:04 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 400 to user: Invalid volume: volume 09e00e3b-ca43-4ab9-83c9-c665144d06c8 is already attached to instances: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:13:04 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-1444cf9d-0d0b-46d8-ae03-a173bdd68155 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108787 Apr 13 18:13:04 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 354/1052] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:13:04 2023] POST /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:13:04 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:04 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:04 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'services' on Instance uuid 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:13:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments/09e00e3b-ca43-4ab9-83c9-c665144d06c8" status: 202 len: 0 microversion: 2.1 time: 0.156456 Apr 13 18:13:04 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 352/1053] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:13:04 2023] DELETE /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments/09e00e3b-ca43-4ab9-83c9-c665144d06c8 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:13:04 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-2f00b50f-547c-4442-bd50-09b889e3c18c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:04 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-2f00b50f-547c-4442-bd50-09b889e3c18c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2f00b50f-547c-4442-bd50-09b889e3c18c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2f00b50f-547c-4442-bd50-09b889e3c18c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2f00b50f-547c-4442-bd50-09b889e3c18c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2f00b50f-547c-4442-bd50-09b889e3c18c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2f00b50f-547c-4442-bd50-09b889e3c18c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2f00b50f-547c-4442-bd50-09b889e3c18c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-2f00b50f-547c-4442-bd50-09b889e3c18c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Apr 13 18:13:04 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 348/1054] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:13:04 2023] GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:22 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:13:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-da8feb1f-b052-41ee-84d9-8a85e5e27375 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd" status: 200 len: 1442 microversion: 2.1 time: 0.177019 Apr 13 18:13:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 355/1055] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:13:22 2023] GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd => generated 1442 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:13:23 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d350bf71-885d-4f3e-acdc-0136ab1469bd", "tag": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:23 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=8 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:23 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] Creating event network-changed:ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance d350bf71-885d-4f3e-acdc-0136ab1469bd on user Apr 13 18:13:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041394 Apr 13 18:13:23 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 353/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:24 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d350bf71-885d-4f3e-acdc-0136ab1469bd", "tag": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=8 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:24 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] Creating event network-changed:ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance d350bf71-885d-4f3e-acdc-0136ab1469bd on user Apr 13 18:13:24 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032995 Apr 13 18:13:24 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 356/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:24 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:13:24 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd" status: 204 len: 0 microversion: 2.1 time: 0.123427 Apr 13 18:13:24 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 349/1058] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:13:24 2023] DELETE /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:13:24 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:24 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:24 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:25 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:13:25 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-75a9aaf5-f144-4819-a6a0-494dd5065f12 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd" status: 200 len: 1566 microversion: 2.1 time: 0.219369 Apr 13 18:13:25 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 354/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:13:24 2023] GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:13:26 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d350bf71-885d-4f3e-acdc-0136ab1469bd", "name": "network-vif-deleted", "tag": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] Creating event network-vif-deleted:ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance d350bf71-885d-4f3e-acdc-0136ab1469bd on user Apr 13 18:13:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032005 Apr 13 18:13:26 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 357/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:26 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d350bf71-885d-4f3e-acdc-0136ab1469bd", "name": "network-vif-unplugged", "status": "completed", "tag": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a"}, {"server_uuid": "d350bf71-885d-4f3e-acdc-0136ab1469bd", "name": "network-vif-plugged", "status": "completed", "tag": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:26 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Creating event network-vif-unplugged:ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance d350bf71-885d-4f3e-acdc-0136ab1469bd on user Apr 13 18:13:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Creating event network-vif-plugged:ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance d350bf71-885d-4f3e-acdc-0136ab1469bd on user Apr 13 18:13:26 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032730 Apr 13 18:13:26 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 350/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:26 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:30 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:30 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:30 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:30 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:13:30 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3" status: 204 len: 0 microversion: 2.1 time: 0.109923 Apr 13 18:13:30 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 355/1062] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:13:30 2023] DELETE /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:13:30 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:30 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:30 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:31 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f752d2c4bf47c182cba7daeb460924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062033ffc6ac4a03964b7ed0bd1f2410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:13:31 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-2b9692b5-87c6-4c95-a317-7cf07e309e15 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3" status: 200 len: 1492 microversion: 2.1 time: 0.315723 Apr 13 18:13:31 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 358/1063] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:13:30 2023] GET /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3 => generated 1492 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:13:31 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f782ce-3912-43ff-b74c-dd645c3a4fe3", "name": "network-vif-unplugged", "status": "completed", "tag": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:31 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] Creating event network-vif-unplugged:bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 on user Apr 13 18:13:31 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156885 Apr 13 18:13:31 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 351/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:13:32 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-ffb7f939-a018-4289-9156-1c0cf0fb789c req-ad08e67d-cb97-47a0-b6f0-986178ecf4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f782ce-3912-43ff-b74c-dd645c3a4fe3", "name": "network-vif-deleted", "tag": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:32 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ffb7f939-a018-4289-9156-1c0cf0fb789c req-ad08e67d-cb97-47a0-b6f0-986178ecf4ad service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:32 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ffb7f939-a018-4289-9156-1c0cf0fb789c req-ad08e67d-cb97-47a0-b6f0-986178ecf4ad service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:32 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-ffb7f939-a018-4289-9156-1c0cf0fb789c req-ad08e67d-cb97-47a0-b6f0-986178ecf4ad service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-ffb7f939-a018-4289-9156-1c0cf0fb789c req-ad08e67d-cb97-47a0-b6f0-986178ecf4ad service nova] Creating event network-vif-deleted:bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 on user Apr 13 18:13:32 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-ffb7f939-a018-4289-9156-1c0cf0fb789c req-ad08e67d-cb97-47a0-b6f0-986178ecf4ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117299 Apr 13 18:13:32 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 356/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:33 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f782ce-3912-43ff-b74c-dd645c3a4fe3", "name": "network-vif-plugged", "status": "completed", "tag": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:33 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] Creating event network-vif-plugged:bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 on user Apr 13 18:13:33 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034400 Apr 13 18:13:33 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 359/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-e90f5c38-2f16-4ba3-9f2d-d44d04afdcb1 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-e90f5c38-2f16-4ba3-9f2d-d44d04afdcb1 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e90f5c38-2f16-4ba3-9f2d-d44d04afdcb1 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e90f5c38-2f16-4ba3-9f2d-d44d04afdcb1 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e90f5c38-2f16-4ba3-9f2d-d44d04afdcb1 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e90f5c38-2f16-4ba3-9f2d-d44d04afdcb1 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e90f5c38-2f16-4ba3-9f2d-d44d04afdcb1 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-e90f5c38-2f16-4ba3-9f2d-d44d04afdcb1 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:53 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-e90f5c38-2f16-4ba3-9f2d-d44d04afdcb1 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.211349 Apr 13 18:13:53 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 352/1067] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:13:53 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 25 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-d80da4d4-d881-44f6-8da1-3e5cafdd4be7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-d80da4d4-d881-44f6-8da1-3e5cafdd4be7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d80da4d4-d881-44f6-8da1-3e5cafdd4be7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d80da4d4-d881-44f6-8da1-3e5cafdd4be7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d80da4d4-d881-44f6-8da1-3e5cafdd4be7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d80da4d4-d881-44f6-8da1-3e5cafdd4be7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d80da4d4-d881-44f6-8da1-3e5cafdd4be7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:54 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-d80da4d4-d881-44f6-8da1-3e5cafdd4be7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:54 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-d80da4d4-d881-44f6-8da1-3e5cafdd4be7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067195 Apr 13 18:13:54 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 357/1068] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:13:54 2023] GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=10 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=18 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:54 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:13:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81" status: 204 len: 0 microversion: 2.1 time: 0.138623 Apr 13 18:13:55 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 360/1069] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:13:54 2023] DELETE /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:13:55 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:13:55 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:55 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:55 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:13:55 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-2af75dcc-0798-4df9-b320-1da1f9c98ea0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81" status: 200 len: 1668 microversion: 2.1 time: 0.176853 Apr 13 18:13:55 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 353/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:13:55 2023] GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => generated 1668 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:13:55 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726eed4a-ac9c-4cef-aa8a-2600b26c1f81", "name": "network-vif-unplugged", "status": "completed", "tag": "1e990464-f0e7-451e-9833-ca1c228c892a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] Creating event network-vif-unplugged:1e990464-f0e7-451e-9833-ca1c228c892a for instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 on user Apr 13 18:13:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043492 Apr 13 18:13:55 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 358/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:56 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5bacdca-8985-4fbe-8acd-9956e367b90e"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:56 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:13:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:56 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:56 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338398 Apr 13 18:13:56 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 361/1072] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:13:56 2023] POST /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:56 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-2eabf677-494f-474d-b5b0-46006f2647b8 req-82b464d5-dce9-41eb-b65a-b2c5602ceca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726eed4a-ac9c-4cef-aa8a-2600b26c1f81", "name": "network-vif-deleted", "tag": "1e990464-f0e7-451e-9833-ca1c228c892a"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2eabf677-494f-474d-b5b0-46006f2647b8 req-82b464d5-dce9-41eb-b65a-b2c5602ceca3 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2eabf677-494f-474d-b5b0-46006f2647b8 req-82b464d5-dce9-41eb-b65a-b2c5602ceca3 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:56 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-2eabf677-494f-474d-b5b0-46006f2647b8 req-82b464d5-dce9-41eb-b65a-b2c5602ceca3 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:56 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-2eabf677-494f-474d-b5b0-46006f2647b8 req-82b464d5-dce9-41eb-b65a-b2c5602ceca3 service nova] Creating event network-vif-deleted:1e990464-f0e7-451e-9833-ca1c228c892a for instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 on user Apr 13 18:13:56 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-2eabf677-494f-474d-b5b0-46006f2647b8 req-82b464d5-dce9-41eb-b65a-b2c5602ceca3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048550 Apr 13 18:13:56 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 354/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:13:57 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726eed4a-ac9c-4cef-aa8a-2600b26c1f81", "name": "network-vif-plugged", "status": "completed", "tag": "1e990464-f0e7-451e-9833-ca1c228c892a"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:13:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:13:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:13:57 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:13:57 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] Creating event network-vif-plugged:1e990464-f0e7-451e-9833-ca1c228c892a for instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 on user Apr 13 18:13:57 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030374 Apr 13 18:13:57 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 359/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:04 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:04 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:04 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:04 user devstack@n-api.service[61676]: DEBUG nova.objects.instance [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'services' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=61676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:14:04 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments/e5bacdca-8985-4fbe-8acd-9956e367b90e" status: 202 len: 0 microversion: 2.1 time: 0.160169 Apr 13 18:14:04 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 362/1075] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:14:04 2023] DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments/e5bacdca-8985-4fbe-8acd-9956e367b90e => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:14:04 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-5fc1ca28-e0df-4d62-b3d5-511a454f2154 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:04 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-5fc1ca28-e0df-4d62-b3d5-511a454f2154 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5fc1ca28-e0df-4d62-b3d5-511a454f2154 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5fc1ca28-e0df-4d62-b3d5-511a454f2154 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5fc1ca28-e0df-4d62-b3d5-511a454f2154 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5fc1ca28-e0df-4d62-b3d5-511a454f2154 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5fc1ca28-e0df-4d62-b3d5-511a454f2154 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:04 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-5fc1ca28-e0df-4d62-b3d5-511a454f2154 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:04 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-5fc1ca28-e0df-4d62-b3d5-511a454f2154 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Apr 13 18:14:04 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 355/1076] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:14:04 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:15 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance d350bf71-885d-4f3e-acdc-0136ab1469bd could not be found. Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:14:15 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd HTTP/1.1 Apr 13 18:14:15 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:14:15 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:14:15 user devstack@n-api.service[61677]: Connection: close Apr 13 18:14:15 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:14:15 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:14:15 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:14:15 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:14:15 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:14:15 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:14:15 user devstack@n-api.service[61677]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:14:15 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:14:15 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:14:15 user devstack@n-api.service[61677]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:14:15 user devstack@n-api.service[61677]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:14:15 user devstack@n-api.service[61677]: method: > Apr 13 18:14:15 user devstack@n-api.service[61677]: exception: Instance d350bf71-885d-4f3e-acdc-0136ab1469bd could not be found. Apr 13 18:14:15 user devstack@n-api.service[61677]: action_args: {'id': 'd350bf71-885d-4f3e-acdc-0136ab1469bd'} Apr 13 18:14:15 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d350bf71-885d-4f3e-acdc-0136ab1469bd could not be found. Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d350bf71-885d-4f3e-acdc-0136ab1469bd could not be found. Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d350bf71-885d-4f3e-acdc-0136ab1469bd could not be found. Apr 13 18:14:15 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:15 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance d350bf71-885d-4f3e-acdc-0136ab1469bd could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:14:15 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-1e483bde-e3b9-4d52-8b54-55f5ea3ff841 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd" status: 404 len: 111 microversion: 2.1 time: 0.151348 Apr 13 18:14:15 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 360/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:14:15 2023] GET /compute/v2.1/servers/d350bf71-885d-4f3e-acdc-0136ab1469bd => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265cff53-3a62-456a-92fd-98025a195518", "tag": "eb4d0c83-d6e6-424e-a956-d52ece4d3228"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:21 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=8 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:21 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=20 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:21 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] Creating event network-changed:eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance 265cff53-3a62-456a-92fd-98025a195518 on user Apr 13 18:14:21 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032293 Apr 13 18:14:21 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 356/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:21 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:14:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] HTTP exception thrown: Instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 could not be found. Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Request method failure captured: Apr 13 18:14:21 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3 HTTP/1.1 Apr 13 18:14:21 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:14:21 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:14:21 user devstack@n-api.service[61677]: Connection: close Apr 13 18:14:21 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:14:21 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:14:21 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:14:21 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:14:21 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEXYu3oAvbinA5hddRdKMZT1Un83a67iRY3BfmivjEFTsSLcuZw_jjUf0I6jm_0_6bPth8jR-A6kRnNH2diczC_bbjS5eDnp7_gZX4SCkwgtb9xhU4pLUhPEkV94CQL6Fezw96FMTg1IsuK6gFIpceLh5GZ72wC6Wr1_UPMwBTbqKHA Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Project-Id: 062033ffc6ac4a03964b7ed0bd1f2410 Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Project-Name: tempest-VolumesActionsTest-927910348 Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/062033ffc6ac4a03964b7ed0bd1f2410"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/062033ffc6ac4a03964b7ed0bd1f2410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/062033ffc6ac4a03964b7ed0bd1f2410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Tenant: tempest-VolumesActionsTest-927910348 Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Tenant-Id: 062033ffc6ac4a03964b7ed0bd1f2410 Apr 13 18:14:21 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-VolumesActionsTest-927910348 Apr 13 18:14:21 user devstack@n-api.service[61677]: X-User: tempest-VolumesActionsTest-927910348-project-member Apr 13 18:14:21 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:14:21 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:14:21 user devstack@n-api.service[61677]: X-User-Id: a8f752d2c4bf47c182cba7daeb460924 Apr 13 18:14:21 user devstack@n-api.service[61677]: X-User-Name: tempest-VolumesActionsTest-927910348-project-member Apr 13 18:14:21 user devstack@n-api.service[61677]: method: > Apr 13 18:14:21 user devstack@n-api.service[61677]: exception: Instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 could not be found. Apr 13 18:14:21 user devstack@n-api.service[61677]: action_args: {'id': 'c6f782ce-3912-43ff-b74c-dd645c3a4fe3'} Apr 13 18:14:21 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 could not be found. Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 could not be found. Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 could not be found. Apr 13 18:14:21 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Returning 404 to user: Instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:14:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-037df0f5-c329-40e5-b81a-3addb64af635 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3" status: 404 len: 111 microversion: 2.1 time: 0.029464 Apr 13 18:14:21 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 361/1079] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:14:21 2023] GET /compute/v2.1/servers/c6f782ce-3912-43ff-b74c-dd645c3a4fe3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:14:21 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1233881546", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "8c0bb9a4-c569-427c-b647-0edba62c1127"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:21 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518" status: 204 len: 0 microversion: 2.1 time: 0.139296 Apr 13 18:14:21 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 363/1080] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:14:21 2023] DELETE /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:21 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] validate_networks() for [('8c0bb9a4-c569-427c-b647-0edba62c1127', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:14:21 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:14:21 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-57279dbf-af68-47fd-bea5-0a9d3f33e0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518" status: 200 len: 1565 microversion: 2.1 time: 0.186246 Apr 13 18:14:21 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 362/1081] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:14:21 2023] GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Getting quotas for project 062033ffc6ac4a03964b7ed0bd1f2410. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Getting quotas for user a8f752d2c4bf47c182cba7daeb460924 and project 062033ffc6ac4a03964b7ed0bd1f2410. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:14:22 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:14:22 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.890079 Apr 13 18:14:22 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 357/1082] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:14:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:14:22 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-5c0f8bc2-aa51-4592-9f57-7eff95157011 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:22 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-5c0f8bc2-aa51-4592-9f57-7eff95157011 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:22 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-5c0f8bc2-aa51-4592-9f57-7eff95157011 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f752d2c4bf47c182cba7daeb460924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062033ffc6ac4a03964b7ed0bd1f2410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:14:22 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-5c0f8bc2-aa51-4592-9f57-7eff95157011 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7" status: 200 len: 1208 microversion: 2.1 time: 0.075652 Apr 13 18:14:22 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 364/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:14:22 2023] GET /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7 => generated 1208 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:14:23 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265cff53-3a62-456a-92fd-98025a195518", "name": "network-vif-unplugged", "status": "completed", "tag": "eb4d0c83-d6e6-424e-a956-d52ece4d3228"}, {"server_uuid": "265cff53-3a62-456a-92fd-98025a195518", "name": "network-vif-plugged", "status": "completed", "tag": "eb4d0c83-d6e6-424e-a956-d52ece4d3228"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:23 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Creating event network-vif-unplugged:eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance 265cff53-3a62-456a-92fd-98025a195518 on user Apr 13 18:14:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Creating event network-vif-plugged:eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance 265cff53-3a62-456a-92fd-98025a195518 on user Apr 13 18:14:23 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033378 Apr 13 18:14:23 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 363/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:25 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265cff53-3a62-456a-92fd-98025a195518", "name": "network-vif-deleted", "tag": "eb4d0c83-d6e6-424e-a956-d52ece4d3228"}, {"name": "network-changed", "server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:25 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] Creating event network-vif-deleted:eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance 265cff53-3a62-456a-92fd-98025a195518 on user Apr 13 18:14:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] Creating event network-changed:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:14:25 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035118 Apr 13 18:14:25 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 358/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:14:25 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:26 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "name": "network-vif-plugged", "status": "completed", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:26 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] Creating event network-vif-plugged:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:14:26 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032714 Apr 13 18:14:26 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 365/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:28 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "name": "network-vif-plugged", "status": "completed", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:28 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:28 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] Creating event network-vif-plugged:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:14:28 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032919 Apr 13 18:14:28 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 364/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:14:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:14:45 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 HTTP/1.1 Apr 13 18:14:45 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:14:45 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:14:45 user devstack@n-api.service[61678]: Connection: close Apr 13 18:14:45 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:14:45 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:14:45 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:14:45 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:14:45 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:14:45 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:14:45 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:14:45 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:14:45 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:14:45 user devstack@n-api.service[61678]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:14:45 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:14:45 user devstack@n-api.service[61678]: method: > Apr 13 18:14:45 user devstack@n-api.service[61678]: exception: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:14:45 user devstack@n-api.service[61678]: action_args: {'id': '726eed4a-ac9c-4cef-aa8a-2600b26c1f81'} Apr 13 18:14:45 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:14:45 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:14:45 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:14:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-abae4a41-36f0-4853-88f8-a82ac3d953ea tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81" status: 404 len: 111 microversion: 2.1 time: 0.037404 Apr 13 18:14:45 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 359/1088] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:14:45 2023] GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:14:45 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:45 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:45 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-6e95a83f-3297-4794-9b42-16621b4eacc1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '.version_select at 0x7f82e2522830>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-6e95a83f-3297-4794-9b42-16621b4eacc1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291612920" status: 202 len: 0 microversion: 2.1 time: 0.034558 Apr 13 18:14:45 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 366/1089] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 18:14:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291612920 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:14:45 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:45 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=14 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:14:45 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-a004e9f1-232c-4e61-88c3-7815f72f6c63 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: .version_select at 0x7f82e241de10>, body: {"keypair": {"name": "tempest-keypair-1180586501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHNju1AA9B90vrvDFy8kmD5AJdCh3GaYjia8Kjy/e5MlIDSLb16RR+R/NvEZ/dLTX9d+CC0afomz07XWjbWwI1ou51yNrVwg6CdbDS3UkcALU2sN/6oDYbdwbwbzb7U3A=="}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:46 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-a004e9f1-232c-4e61-88c3-7815f72f6c63 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:14:46 user devstack@n-api.service[61677]: DEBUG nova.quota [None req-a004e9f1-232c-4e61-88c3-7815f72f6c63 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for user 0ac81be2a2db40b2acbae911db8086ca and project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'key_pairs'} {{(pid=61677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:14:46 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-a004e9f1-232c-4e61-88c3-7815f72f6c63 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063076 Apr 13 18:14:46 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 365/1090] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:14:45 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1854731271", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "182886ee-6e1e-4146-903d-955b8b6726f4"}], "security_groups": [{"name": "tempest-securitygroup--455559783"}], "key_name": "tempest-keypair-1180586501", "user_data": "}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] validate_networks() for [('182886ee-6e1e-4146-903d-955b8b6726f4', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting quotas for user 0ac81be2a2db40b2acbae911db8086ca and project c5bfb2b952aa4fd8a66d4eb5aa052e97. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:14:47 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:14:47 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.593204 Apr 13 18:14:47 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 360/1091] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:14:47 2023] POST /compute/v2.1/servers => generated 399 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:14:48 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-da334000-d4de-47a8-aa03-af2122599f5c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:48 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-da334000-d4de-47a8-aa03-af2122599f5c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:48 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-da334000-d4de-47a8-aa03-af2122599f5c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:14:48 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-da334000-d4de-47a8-aa03-af2122599f5c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1" status: 200 len: 1236 microversion: 2.1 time: 0.070106 Apr 13 18:14:48 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 367/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:14:48 2023] GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:14:50 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795e0737-96c6-4fea-8806-acab63dca5c1", "tag": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:50 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] Creating event network-changed:9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance 795e0737-96c6-4fea-8806-acab63dca5c1 on user Apr 13 18:14:50 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033380 Apr 13 18:14:50 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 366/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:14:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:52 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795e0737-96c6-4fea-8806-acab63dca5c1", "name": "network-vif-plugged", "status": "completed", "tag": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] Creating event network-vif-plugged:9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance 795e0737-96c6-4fea-8806-acab63dca5c1 on user Apr 13 18:14:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035336 Apr 13 18:14:52 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 361/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:14:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:55 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795e0737-96c6-4fea-8806-acab63dca5c1", "name": "network-vif-plugged", "status": "completed", "tag": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:14:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:55 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] Creating event network-vif-plugged:9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance 795e0737-96c6-4fea-8806-acab63dca5c1 on user Apr 13 18:14:55 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031018 Apr 13 18:14:55 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 368/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:14:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:14:55 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-3baa7f28-b8f8-401a-9d6c-f1069a302ed7 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:14:55 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-3baa7f28-b8f8-401a-9d6c-f1069a302ed7 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:14:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3baa7f28-b8f8-401a-9d6c-f1069a302ed7 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3baa7f28-b8f8-401a-9d6c-f1069a302ed7 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3baa7f28-b8f8-401a-9d6c-f1069a302ed7 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3baa7f28-b8f8-401a-9d6c-f1069a302ed7 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:14:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3baa7f28-b8f8-401a-9d6c-f1069a302ed7 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:14:55 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-3baa7f28-b8f8-401a-9d6c-f1069a302ed7 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:14:55 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-3baa7f28-b8f8-401a-9d6c-f1069a302ed7 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046711 Apr 13 18:14:55 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 367/1096] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:14:54 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:15:09 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e349b-11fe-47a6-b47e-e965774b00a2", "tag": "06a96589-5953-47a0-8e30-efd8d4dff9f3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:15:09 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:09 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:09 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:09 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:09 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:09 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] Creating event network-changed:06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 on user Apr 13 18:15:09 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038856 Apr 13 18:15:09 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 362/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:15:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:15:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2" status: 204 len: 0 microversion: 2.1 time: 0.168344 Apr 13 18:15:11 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 369/1098] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:15:11 2023] DELETE /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell0:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=8 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:15:11 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '414376a2c1204907aadfc83bbe3348e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0b8c72627d48718f4d6657f0c220a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:11 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-dbec4afd-7892-44d3-8900-34ec23c4ef11 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2" status: 200 len: 1573 microversion: 2.1 time: 0.289889 Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:11 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 368/1099] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:15:11 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2 => generated 1573 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:15:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance 265cff53-3a62-456a-92fd-98025a195518 could not be found. Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:15:11 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518 HTTP/1.1 Apr 13 18:15:11 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:15:11 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:15:11 user devstack@n-api.service[61678]: Connection: close Apr 13 18:15:11 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:15:11 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:15:11 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:15:11 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:15:11 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:15:11 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:15:11 user devstack@n-api.service[61678]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:15:11 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:15:11 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:15:11 user devstack@n-api.service[61678]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:15:11 user devstack@n-api.service[61678]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:15:11 user devstack@n-api.service[61678]: method: > Apr 13 18:15:11 user devstack@n-api.service[61678]: exception: Instance 265cff53-3a62-456a-92fd-98025a195518 could not be found. Apr 13 18:15:11 user devstack@n-api.service[61678]: action_args: {'id': '265cff53-3a62-456a-92fd-98025a195518'} Apr 13 18:15:11 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265cff53-3a62-456a-92fd-98025a195518 could not be found. Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265cff53-3a62-456a-92fd-98025a195518 could not be found. Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265cff53-3a62-456a-92fd-98025a195518 could not be found. Apr 13 18:15:11 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:11 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance 265cff53-3a62-456a-92fd-98025a195518 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:15:11 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-719491ff-0950-4bbd-9a9d-c9b2c8e92921 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518" status: 404 len: 111 microversion: 2.1 time: 0.041491 Apr 13 18:15:11 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 363/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:15:11 2023] GET /compute/v2.1/servers/265cff53-3a62-456a-92fd-98025a195518 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e349b-11fe-47a6-b47e-e965774b00a2", "name": "network-vif-unplugged", "status": "completed", "tag": "06a96589-5953-47a0-8e30-efd8d4dff9f3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:11 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] Creating event network-vif-unplugged:06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 on user Apr 13 18:15:11 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112329 Apr 13 18:15:11 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 370/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:15:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:15:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:15:12 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:15:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:15:12 user devstack@n-api.service[61678]: request: DELETE /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 HTTP/1.1 Apr 13 18:15:12 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:15:12 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:15:12 user devstack@n-api.service[61678]: Connection: close Apr 13 18:15:12 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:15:12 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:15:12 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:15:12 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:15:12 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:15:12 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:15:12 user devstack@n-api.service[61678]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:15:12 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:15:12 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:15:12 user devstack@n-api.service[61678]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:15:12 user devstack@n-api.service[61678]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:15:12 user devstack@n-api.service[61678]: method: > Apr 13 18:15:12 user devstack@n-api.service[61678]: exception: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61678]: action_args: {'id': 'c5342d27-7121-489f-b1b7-c02d664e7fc3'} Apr 13 18:15:12 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:15:12 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ec1b2988-816b-4f8b-94fe-28b2ae5be437 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3" status: 404 len: 111 microversion: 2.1 time: 0.033230 Apr 13 18:15:12 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 364/1102] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:15:12 2023] DELETE /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HTTP exception thrown: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Request method failure captured: Apr 13 18:15:12 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 HTTP/1.1 Apr 13 18:15:12 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:15:12 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:15:12 user devstack@n-api.service[61676]: Connection: close Apr 13 18:15:12 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:15:12 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:15:12 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:15:12 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:15:12 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEKxuwD8JF0T5pBlikbXw0-wjAprIG48r6GWaRsxl6v436ZWyIRQmkUVJRWu83_Y5Z7PK9RC-EtGbAHx-y2hECosqJAN8NpnyxPsx6PlHIpk9k0h7lk1RXNhhmjyp9_Fed31Vna4nDbE3MrwxY1jSz9xNHgCtEzQuzSR19RYWs3f_gc Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Project-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Project-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25f789d52faa469c802d7c1281ed8c82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Tenant: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Tenant-Id: 25f789d52faa469c802d7c1281ed8c82 Apr 13 18:15:12 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858052268 Apr 13 18:15:12 user devstack@n-api.service[61676]: X-User: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:15:12 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:15:12 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:15:12 user devstack@n-api.service[61676]: X-User-Id: 1cd4d2b21dda452dab66c1973c3beec1 Apr 13 18:15:12 user devstack@n-api.service[61676]: X-User-Name: tempest-TestVolumeBootPattern-1858052268-project-member Apr 13 18:15:12 user devstack@n-api.service[61676]: method: > Apr 13 18:15:12 user devstack@n-api.service[61676]: exception: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61676]: action_args: {'id': 'c5342d27-7121-489f-b1b7-c02d664e7fc3'} Apr 13 18:15:12 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. Apr 13 18:15:12 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:15:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Returning 404 to user: Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:15:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f591c19f-5406-49a9-9ce8-dc69478ced84 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3" status: 404 len: 111 microversion: 2.1 time: 0.048395 Apr 13 18:15:12 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 371/1103] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:15:12 2023] GET /compute/v2.1/servers/c5342d27-7121-489f-b1b7-c02d664e7fc3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:15:12 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f752d2c4bf47c182cba7daeb460924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062033ffc6ac4a03964b7ed0bd1f2410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:15:12 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-12e42ba2-93c3-41cf-abbb-dfc5a87e2496 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7" status: 200 len: 1486 microversion: 2.1 time: 0.193417 Apr 13 18:15:12 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 369/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:15:12 2023] GET /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7 => generated 1486 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:15:13 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e349b-11fe-47a6-b47e-e965774b00a2", "name": "network-vif-deleted", "tag": "06a96589-5953-47a0-8e30-efd8d4dff9f3"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:15:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] Creating event network-vif-deleted:06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 on user Apr 13 18:15:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048104 Apr 13 18:15:13 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 365/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:15:13 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e349b-11fe-47a6-b47e-e965774b00a2", "name": "network-vif-plugged", "status": "completed", "tag": "06a96589-5953-47a0-8e30-efd8d4dff9f3"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:15:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] Creating event network-vif-plugged:06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 on user Apr 13 18:15:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036303 Apr 13 18:15:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 372/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:15:14 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-be79621a-b209-49cf-8b4a-ed840110b597 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Calling method '.version_select at 0x7f82e220d120>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:15:14 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-be79621a-b209-49cf-8b4a-ed840110b597 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1422503133" status: 202 len: 0 microversion: 2.1 time: 0.024690 Apr 13 18:15:14 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 370/1107] 10.0.0.210 () {62 vars in 1340 bytes} [Thu Apr 13 18:15:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1422503133 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=8 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=8 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:15:38 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:15:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-29e93ef9-e04b-47cd-b5de-76195ae3d37a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1" status: 200 len: 1546 microversion: 2.1 time: 0.592637 Apr 13 18:15:38 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 366/1108] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:15:38 2023] GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 => generated 1546 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:01 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] HTTP exception thrown: Instance e65e349b-11fe-47a6-b47e-e965774b00a2 could not be found. Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Request method failure captured: Apr 13 18:16:01 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2 HTTP/1.1 Apr 13 18:16:01 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:16:01 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:16:01 user devstack@n-api.service[61676]: Connection: close Apr 13 18:16:01 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:16:01 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:16:01 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:16:01 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:16:01 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEUl4kEnJdtLx77AelYaSoJBn_EB6UFNtTdpOOvI-tOd0QvMZSbmS-lJJWptVCeU-oIvfGnoGlxDqYLYytHint6zg2rgjHcQWHClXzBaxhsA1fF9BpnFrnFOSW0t4pyuRg7v5u2_-hFLzdtujaiNfl5eBLjiV1qvabZ5cHBMLswQUvw Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Project-Id: 3d0b8c72627d48718f4d6657f0c220a3 Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1434998905 Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3d0b8c72627d48718f4d6657f0c220a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d0b8c72627d48718f4d6657f0c220a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d0b8c72627d48718f4d6657f0c220a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Tenant: tempest-SnapshotDataIntegrityTests-1434998905 Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Tenant-Id: 3d0b8c72627d48718f4d6657f0c220a3 Apr 13 18:16:01 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1434998905 Apr 13 18:16:01 user devstack@n-api.service[61676]: X-User: tempest-SnapshotDataIntegrityTests-1434998905-project-member Apr 13 18:16:01 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:16:01 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:16:01 user devstack@n-api.service[61676]: X-User-Id: 414376a2c1204907aadfc83bbe3348e7 Apr 13 18:16:01 user devstack@n-api.service[61676]: X-User-Name: tempest-SnapshotDataIntegrityTests-1434998905-project-member Apr 13 18:16:01 user devstack@n-api.service[61676]: method: > Apr 13 18:16:01 user devstack@n-api.service[61676]: exception: Instance e65e349b-11fe-47a6-b47e-e965774b00a2 could not be found. Apr 13 18:16:01 user devstack@n-api.service[61676]: action_args: {'id': 'e65e349b-11fe-47a6-b47e-e965774b00a2'} Apr 13 18:16:01 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65e349b-11fe-47a6-b47e-e965774b00a2 could not be found. Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65e349b-11fe-47a6-b47e-e965774b00a2 could not be found. Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65e349b-11fe-47a6-b47e-e965774b00a2 could not be found. Apr 13 18:16:01 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:16:01 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Returning 404 to user: Instance e65e349b-11fe-47a6-b47e-e965774b00a2 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:16:01 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-77385d5b-3d13-4d7a-ba97-e4dcfd9b19b3 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2" status: 404 len: 111 microversion: 2.1 time: 0.049844 Apr 13 18:16:01 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 373/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:16:01 2023] GET /compute/v2.1/servers/e65e349b-11fe-47a6-b47e-e965774b00a2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:16:01 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=12 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:01 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:01 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-b72ab629-3d0f-4ff4-b416-41ec417b29be tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Calling method '.version_select at 0x7f82e22c9a20>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:16:02 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-b72ab629-3d0f-4ff4-b416-41ec417b29be tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-70279965" status: 202 len: 0 microversion: 2.1 time: 0.030011 Apr 13 18:16:02 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 371/1110] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 13 18:16:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-70279965 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:13 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:16:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7" status: 204 len: 0 microversion: 2.1 time: 0.124376 Apr 13 18:16:13 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 367/1111] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:16:13 2023] DELETE /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:13 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f752d2c4bf47c182cba7daeb460924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062033ffc6ac4a03964b7ed0bd1f2410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:16:13 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0de4eded-6c64-494d-9ebd-197179dc05f8 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7" status: 200 len: 1492 microversion: 2.1 time: 0.166791 Apr 13 18:16:13 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 374/1112] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:16:13 2023] GET /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7 => generated 1492 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:16:13 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:13 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "name": "network-vif-unplugged", "status": "completed", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:16:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:13 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] Creating event network-vif-unplugged:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:16:13 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034953 Apr 13 18:16:13 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 372/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:16:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:16:15 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-c3cd825d-579d-4290-89c1-3d4d6970994e req-a83621c2-1638-4f29-b95d-65bb0d9e27f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "name": "network-vif-deleted", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:16:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c3cd825d-579d-4290-89c1-3d4d6970994e req-a83621c2-1638-4f29-b95d-65bb0d9e27f5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c3cd825d-579d-4290-89c1-3d4d6970994e req-a83621c2-1638-4f29-b95d-65bb0d9e27f5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:15 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-c3cd825d-579d-4290-89c1-3d4d6970994e req-a83621c2-1638-4f29-b95d-65bb0d9e27f5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-c3cd825d-579d-4290-89c1-3d4d6970994e req-a83621c2-1638-4f29-b95d-65bb0d9e27f5 service nova] Creating event network-vif-deleted:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:16:15 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-c3cd825d-579d-4290-89c1-3d4d6970994e req-a83621c2-1638-4f29-b95d-65bb0d9e27f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030707 Apr 13 18:16:15 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 368/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:16:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:16:15 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "name": "network-vif-plugged", "status": "completed", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}, {"server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "name": "network-vif-plugged", "status": "completed", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}, {"server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "name": "network-vif-plugged", "status": "completed", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}, {"server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "name": "network-vif-unplugged", "status": "completed", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}, {"server_uuid": "b2a75c59-c54c-49ea-908f-ff7856befac7", "name": "network-vif-plugged", "status": "completed", "tag": "c98bd656-3b1a-4b2d-adb9-026b171ef063"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:16:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:15 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Creating event network-vif-plugged:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:16:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Creating event network-vif-plugged:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:16:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Creating event network-vif-plugged:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:16:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Creating event network-vif-unplugged:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:16:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Creating event network-vif-plugged:c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance b2a75c59-c54c-49ea-908f-ff7856befac7 on user Apr 13 18:16:15 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031271 Apr 13 18:16:15 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 375/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:16:15 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-50e56f2a-8993-4746-b988-bbf7dd2876e1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-50e56f2a-8993-4746-b988-bbf7dd2876e1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50e56f2a-8993-4746-b988-bbf7dd2876e1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50e56f2a-8993-4746-b988-bbf7dd2876e1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50e56f2a-8993-4746-b988-bbf7dd2876e1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50e56f2a-8993-4746-b988-bbf7dd2876e1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50e56f2a-8993-4746-b988-bbf7dd2876e1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-50e56f2a-8993-4746-b988-bbf7dd2876e1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:39 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-50e56f2a-8993-4746-b988-bbf7dd2876e1 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.192181 Apr 13 18:16:39 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 373/1116] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:16:38 2023] GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-interface => generated 283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:16:40 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:40 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795e0737-96c6-4fea-8806-acab63dca5c1", "tag": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:16:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] Creating event network-changed:9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance 795e0737-96c6-4fea-8806-acab63dca5c1 on user Apr 13 18:16:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039432 Apr 13 18:16:40 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 369/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:16:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0cde6a0b-10b2-42aa-9e60-bf1990ea9ebb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0cde6a0b-10b2-42aa-9e60-bf1990ea9ebb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0cde6a0b-10b2-42aa-9e60-bf1990ea9ebb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0cde6a0b-10b2-42aa-9e60-bf1990ea9ebb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0cde6a0b-10b2-42aa-9e60-bf1990ea9ebb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0cde6a0b-10b2-42aa-9e60-bf1990ea9ebb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0cde6a0b-10b2-42aa-9e60-bf1990ea9ebb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:41 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0cde6a0b-10b2-42aa-9e60-bf1990ea9ebb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:41 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0cde6a0b-10b2-42aa-9e60-bf1990ea9ebb tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/ips" status: 200 len: 149 microversion: 2.1 time: 0.044647 Apr 13 18:16:41 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 376/1118] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 18:16:41 2023] GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:16:44 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7"}} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:16:44 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:16:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:44 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:44 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286578 Apr 13 18:16:44 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 374/1119] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:16:44 2023] POST /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:52 user devstack@n-api.service[61678]: DEBUG nova.objects.instance [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'services' on Instance uuid 795e0737-96c6-4fea-8806-acab63dca5c1 {{(pid=61678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:16:52 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-volume_attachments/9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7" status: 202 len: 0 microversion: 2.1 time: 0.291027 Apr 13 18:16:52 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 370/1120] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:16:52 2023] DELETE /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-volume_attachments/9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-a08666cd-08ce-4a84-b9ce-c202d7627bbf tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-a08666cd-08ce-4a84-b9ce-c202d7627bbf tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a08666cd-08ce-4a84-b9ce-c202d7627bbf tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a08666cd-08ce-4a84-b9ce-c202d7627bbf tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a08666cd-08ce-4a84-b9ce-c202d7627bbf tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a08666cd-08ce-4a84-b9ce-c202d7627bbf tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a08666cd-08ce-4a84-b9ce-c202d7627bbf tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:16:52 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-a08666cd-08ce-4a84-b9ce-c202d7627bbf tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:16:52 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-a08666cd-08ce-4a84-b9ce-c202d7627bbf tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048543 Apr 13 18:16:52 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 377/1121] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:16:52 2023] GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] HTTP exception thrown: Instance b2a75c59-c54c-49ea-908f-ff7856befac7 could not be found. Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Request method failure captured: Apr 13 18:17:03 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7 HTTP/1.1 Apr 13 18:17:03 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:17:03 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:17:03 user devstack@n-api.service[61677]: Connection: close Apr 13 18:17:03 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:17:03 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:17:03 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:17:03 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:17:03 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEXYu3oAvbinA5hddRdKMZT1Un83a67iRY3BfmivjEFTsSLcuZw_jjUf0I6jm_0_6bPth8jR-A6kRnNH2diczC_bbjS5eDnp7_gZX4SCkwgtb9xhU4pLUhPEkV94CQL6Fezw96FMTg1IsuK6gFIpceLh5GZ72wC6Wr1_UPMwBTbqKHA Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Project-Id: 062033ffc6ac4a03964b7ed0bd1f2410 Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Project-Name: tempest-VolumesActionsTest-927910348 Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/062033ffc6ac4a03964b7ed0bd1f2410"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/062033ffc6ac4a03964b7ed0bd1f2410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/062033ffc6ac4a03964b7ed0bd1f2410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Tenant: tempest-VolumesActionsTest-927910348 Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Tenant-Id: 062033ffc6ac4a03964b7ed0bd1f2410 Apr 13 18:17:03 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-VolumesActionsTest-927910348 Apr 13 18:17:03 user devstack@n-api.service[61677]: X-User: tempest-VolumesActionsTest-927910348-project-member Apr 13 18:17:03 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:17:03 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:17:03 user devstack@n-api.service[61677]: X-User-Id: a8f752d2c4bf47c182cba7daeb460924 Apr 13 18:17:03 user devstack@n-api.service[61677]: X-User-Name: tempest-VolumesActionsTest-927910348-project-member Apr 13 18:17:03 user devstack@n-api.service[61677]: method: > Apr 13 18:17:03 user devstack@n-api.service[61677]: exception: Instance b2a75c59-c54c-49ea-908f-ff7856befac7 could not be found. Apr 13 18:17:03 user devstack@n-api.service[61677]: action_args: {'id': 'b2a75c59-c54c-49ea-908f-ff7856befac7'} Apr 13 18:17:03 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a75c59-c54c-49ea-908f-ff7856befac7 could not be found. Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a75c59-c54c-49ea-908f-ff7856befac7 could not be found. Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a75c59-c54c-49ea-908f-ff7856befac7 could not be found. Apr 13 18:17:03 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:17:03 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Returning 404 to user: Instance b2a75c59-c54c-49ea-908f-ff7856befac7 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:17:03 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-31ce6ea1-bc90-4cbf-873a-14ea78ec028f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7" status: 404 len: 111 microversion: 2.1 time: 0.145587 Apr 13 18:17:03 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 375/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:17:03 2023] GET /compute/v2.1/servers/b2a75c59-c54c-49ea-908f-ff7856befac7 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-7664b622-c9fb-4f35-9586-47467f0badf0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-7664b622-c9fb-4f35-9586-47467f0badf0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7664b622-c9fb-4f35-9586-47467f0badf0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7664b622-c9fb-4f35-9586-47467f0badf0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7664b622-c9fb-4f35-9586-47467f0badf0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7664b622-c9fb-4f35-9586-47467f0badf0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7664b622-c9fb-4f35-9586-47467f0badf0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:42 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-7664b622-c9fb-4f35-9586-47467f0badf0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:42 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-7664b622-c9fb-4f35-9586-47467f0badf0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057165 Apr 13 18:17:42 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 371/1123] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:17:42 2023] GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:42 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Going to try to terminate instance {{(pid=61676) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:17:42 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1" status: 204 len: 0 microversion: 2.1 time: 0.112665 Apr 13 18:17:42 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 378/1124] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:17:42 2023] DELETE /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:42 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:43 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795e0737-96c6-4fea-8806-acab63dca5c1", "name": "network-vif-unplugged", "status": "completed", "tag": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:17:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:43 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] Creating event network-vif-unplugged:9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance 795e0737-96c6-4fea-8806-acab63dca5c1 on user Apr 13 18:17:43 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028202 Apr 13 18:17:43 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 372/1125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:17:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:17:43 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:17:43 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-427db770-cb4a-40c6-9183-0998159b2937 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1" status: 200 len: 1671 microversion: 2.1 time: 0.471034 Apr 13 18:17:43 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 376/1126] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:17:42 2023] GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 => generated 1671 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:17:44 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-09a7d7e4-bf1e-4953-a0b4-c69b8b7ffb24 req-8bc8e34b-3ad8-4598-bfaf-00b0163445d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795e0737-96c6-4fea-8806-acab63dca5c1", "name": "network-vif-deleted", "tag": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:17:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-09a7d7e4-bf1e-4953-a0b4-c69b8b7ffb24 req-8bc8e34b-3ad8-4598-bfaf-00b0163445d3 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-09a7d7e4-bf1e-4953-a0b4-c69b8b7ffb24 req-8bc8e34b-3ad8-4598-bfaf-00b0163445d3 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:44 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-09a7d7e4-bf1e-4953-a0b4-c69b8b7ffb24 req-8bc8e34b-3ad8-4598-bfaf-00b0163445d3 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:44 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-09a7d7e4-bf1e-4953-a0b4-c69b8b7ffb24 req-8bc8e34b-3ad8-4598-bfaf-00b0163445d3 service nova] Creating event network-vif-deleted:9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance 795e0737-96c6-4fea-8806-acab63dca5c1 on user Apr 13 18:17:44 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-09a7d7e4-bf1e-4953-a0b4-c69b8b7ffb24 req-8bc8e34b-3ad8-4598-bfaf-00b0163445d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143633 Apr 13 18:17:44 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 379/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:17:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:17:44 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1535986949", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:17:44 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] validate_networks() for [('c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:17:45 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795e0737-96c6-4fea-8806-acab63dca5c1", "name": "network-vif-plugged", "status": "completed", "tag": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:17:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:45 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:45 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] Creating event network-vif-plugged:9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance 795e0737-96c6-4fea-8806-acab63dca5c1 on user Apr 13 18:17:45 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Apr 13 18:17:45 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 377/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:17:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Getting quotas for project 04e0d520107b4881bbd5a63f7033010d. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Getting quotas for user 447d3b6af7df4487a0e7113cdab7ee39 and project 04e0d520107b4881bbd5a63f7033010d. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:17:45 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:17:45 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.525780 Apr 13 18:17:45 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 373/1129] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:17:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:17:45 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-14240058-ba5e-412d-b786-999ec4f2ee49 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:17:45 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-14240058-ba5e-412d-b786-999ec4f2ee49 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:17:45 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-14240058-ba5e-412d-b786-999ec4f2ee49 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d3b6af7df4487a0e7113cdab7ee39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0d520107b4881bbd5a63f7033010d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:17:45 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-14240058-ba5e-412d-b786-999ec4f2ee49 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384" status: 200 len: 1213 microversion: 2.1 time: 0.135793 Apr 13 18:17:45 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 380/1130] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:17:45 2023] GET /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384 => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 18:17:47 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "363170b9-0f09-4d89-9a9d-b1bb6756b384", "tag": "b0c0f448-716a-403a-86fc-863bc8b62206"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:17:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:47 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] Creating event network-changed:b0c0f448-716a-403a-86fc-863bc8b62206 for instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 on user Apr 13 18:17:47 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038502 Apr 13 18:17:47 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 378/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:17:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:17:49 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363170b9-0f09-4d89-9a9d-b1bb6756b384", "name": "network-vif-plugged", "status": "completed", "tag": "b0c0f448-716a-403a-86fc-863bc8b62206"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:17:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:49 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] Creating event network-vif-plugged:b0c0f448-716a-403a-86fc-863bc8b62206 for instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 on user Apr 13 18:17:49 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028155 Apr 13 18:17:49 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 374/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:17:51 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363170b9-0f09-4d89-9a9d-b1bb6756b384", "name": "network-vif-plugged", "status": "completed", "tag": "b0c0f448-716a-403a-86fc-863bc8b62206"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:17:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:17:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:17:51 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:17:51 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] Creating event network-vif-plugged:b0c0f448-716a-403a-86fc-863bc8b62206 for instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 on user Apr 13 18:17:51 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030884 Apr 13 18:17:51 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 381/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=10 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:33 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:18:33 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 HTTP/1.1 Apr 13 18:18:33 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:18:33 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:18:33 user devstack@n-api.service[61677]: Connection: close Apr 13 18:18:33 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:18:33 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:18:33 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:18:33 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:18:33 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:33 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:33 user devstack@n-api.service[61677]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:33 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:18:33 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:18:33 user devstack@n-api.service[61677]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:18:33 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:33 user devstack@n-api.service[61677]: method: > Apr 13 18:18:33 user devstack@n-api.service[61677]: exception: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:33 user devstack@n-api.service[61677]: action_args: {'id': '795e0737-96c6-4fea-8806-acab63dca5c1'} Apr 13 18:18:33 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:33 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:33 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:18:33 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-566b97fc-b424-4ea4-9d80-dc43351cff70 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1" status: 404 len: 111 microversion: 2.1 time: 0.038102 Apr 13 18:18:33 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 379/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:18:33 2023] GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:18:33 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:18:33 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:18:33 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:18:33 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=12 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:18:33 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-d86d5159-993b-452e-b048-bd164f8d55b7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '.version_select at 0x7f82e2614940>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:33 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-d86d5159-993b-452e-b048-bd164f8d55b7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180586501" status: 202 len: 0 microversion: 2.1 time: 0.039467 Apr 13 18:18:33 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 375/1135] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 18:18:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180586501 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:35 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d3b6af7df4487a0e7113cdab7ee39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0d520107b4881bbd5a63f7033010d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:18:35 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-aafb7fcc-cc71-4710-99b3-348ac51d633a tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384" status: 200 len: 1497 microversion: 2.1 time: 0.209375 Apr 13 18:18:35 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 382/1136] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:18:35 2023] GET /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384 => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:36 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:18:36 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 HTTP/1.1 Apr 13 18:18:36 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:18:36 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:18:36 user devstack@n-api.service[61677]: Connection: close Apr 13 18:18:36 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:18:36 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:18:36 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:18:36 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:18:36 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:36 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:36 user devstack@n-api.service[61677]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:36 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:18:36 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:18:36 user devstack@n-api.service[61677]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:18:36 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:36 user devstack@n-api.service[61677]: method: > Apr 13 18:18:36 user devstack@n-api.service[61677]: exception: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61677]: action_args: {'id': '795e0737-96c6-4fea-8806-acab63dca5c1'} Apr 13 18:18:36 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:18:36 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9aad86ef-9b25-4c67-9e73-217bef1433c9 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1" status: 404 len: 111 microversion: 2.1 time: 0.037736 Apr 13 18:18:36 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 380/1137] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:18:36 2023] DELETE /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:36 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:18:36 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 HTTP/1.1 Apr 13 18:18:36 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:18:36 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:18:36 user devstack@n-api.service[61678]: Connection: close Apr 13 18:18:36 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:18:36 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:18:36 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:18:36 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:18:36 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:36 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:36 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:36 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:18:36 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:18:36 user devstack@n-api.service[61678]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:18:36 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:36 user devstack@n-api.service[61678]: method: > Apr 13 18:18:36 user devstack@n-api.service[61678]: exception: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61678]: action_args: {'id': '795e0737-96c6-4fea-8806-acab63dca5c1'} Apr 13 18:18:36 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. Apr 13 18:18:36 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:36 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 795e0737-96c6-4fea-8806-acab63dca5c1 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:18:36 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-534993ec-bba5-4fd2-9837-d71ba671fd3d tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1" status: 404 len: 111 microversion: 2.1 time: 0.035217 Apr 13 18:18:36 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 376/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:18:36 2023] GET /compute/v2.1/servers/795e0737-96c6-4fea-8806-acab63dca5c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:18:38 user devstack@n-api.service[61676]: request: DELETE /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 HTTP/1.1 Apr 13 18:18:38 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:18:38 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:18:38 user devstack@n-api.service[61676]: Connection: close Apr 13 18:18:38 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:18:38 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:18:38 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:18:38 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:18:38 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:38 user devstack@n-api.service[61676]: method: > Apr 13 18:18:38 user devstack@n-api.service[61676]: exception: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: action_args: {'id': '726eed4a-ac9c-4cef-aa8a-2600b26c1f81'} Apr 13 18:18:38 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:18:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-5dc28517-3ea6-45e6-9b6d-eab258ed18ad tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81" status: 404 len: 111 microversion: 2.1 time: 0.036099 Apr 13 18:18:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 383/1139] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:18:38 2023] DELETE /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:38 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:18:38 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 HTTP/1.1 Apr 13 18:18:38 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:18:38 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:18:38 user devstack@n-api.service[61677]: Connection: close Apr 13 18:18:38 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:18:38 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:18:38 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:18:38 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:18:38 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:38 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61677]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:38 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:18:38 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:18:38 user devstack@n-api.service[61677]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:18:38 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:38 user devstack@n-api.service[61677]: method: > Apr 13 18:18:38 user devstack@n-api.service[61677]: exception: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61677]: action_args: {'id': '726eed4a-ac9c-4cef-aa8a-2600b26c1f81'} Apr 13 18:18:38 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. Apr 13 18:18:38 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:18:38 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-9ad2d088-23d9-4233-9d19-1ec12538a13a tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81" status: 404 len: 111 microversion: 2.1 time: 0.028003 Apr 13 18:18:38 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 381/1140] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:18:38 2023] GET /compute/v2.1/servers/726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:18:38 user devstack@n-api.service[61678]: request: DELETE /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc HTTP/1.1 Apr 13 18:18:38 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:18:38 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:18:38 user devstack@n-api.service[61678]: Connection: close Apr 13 18:18:38 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:18:38 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:18:38 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:18:38 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:18:38 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:38 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:38 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:18:38 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:18:38 user devstack@n-api.service[61678]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:18:38 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:38 user devstack@n-api.service[61678]: method: > Apr 13 18:18:38 user devstack@n-api.service[61678]: exception: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61678]: action_args: {'id': '94db3503-3352-4326-b52a-f8af1061fafc'} Apr 13 18:18:38 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:18:38 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-87346e04-8488-4cf0-a4d6-7c43632fcb78 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc" status: 404 len: 111 microversion: 2.1 time: 0.036085 Apr 13 18:18:38 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 377/1141] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:18:38 2023] DELETE /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.wsgi [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:18:38 user devstack@n-api.service[61676]: request: GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc HTTP/1.1 Apr 13 18:18:38 user devstack@n-api.service[61676]: Accept: application/json Apr 13 18:18:38 user devstack@n-api.service[61676]: Accept-Encoding: identity Apr 13 18:18:38 user devstack@n-api.service[61676]: Connection: close Apr 13 18:18:38 user devstack@n-api.service[61676]: Content-Length: 0 Apr 13 18:18:38 user devstack@n-api.service[61676]: Content-Type: application/json Apr 13 18:18:38 user devstack@n-api.service[61676]: Host: 10.0.0.210 Apr 13 18:18:38 user devstack@n-api.service[61676]: Openstack-System-Scope: None Apr 13 18:18:38 user devstack@n-api.service[61676]: User-Agent: python-urllib3/1.26.15 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Domain-Id: None Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Domain-Name: None Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Identity-Status: Confirmed Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Is-Admin-Project: True Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Project-Domain-Id: default Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Project-Domain-Name: Default Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Role: member,reader Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Roles: member,reader Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User-Domain-Id: default Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User-Domain-Name: Default Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:18:38 user devstack@n-api.service[61676]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:38 user devstack@n-api.service[61676]: method: > Apr 13 18:18:38 user devstack@n-api.service[61676]: exception: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: action_args: {'id': '94db3503-3352-4326-b52a-f8af1061fafc'} Apr 13 18:18:38 user devstack@n-api.service[61676]: {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. Apr 13 18:18:38 user devstack@n-api.service[61676]: ERROR nova.api.openstack.wsgi Apr 13 18:18:38 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 94db3503-3352-4326-b52a-f8af1061fafc could not be found. {{(pid=61676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:18:38 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-86736ffa-e5b8-4327-84b3-957563d25e7b tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc" status: 404 len: 111 microversion: 2.1 time: 0.036034 Apr 13 18:18:38 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 384/1142] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:18:38 2023] GET /compute/v2.1/servers/94db3503-3352-4326-b52a-f8af1061fafc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:18:40 user devstack@n-api.service[61677]: request: DELETE /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 HTTP/1.1 Apr 13 18:18:40 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:18:40 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:18:40 user devstack@n-api.service[61677]: Connection: close Apr 13 18:18:40 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:18:40 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:18:40 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:18:40 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:18:40 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:40 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:40 user devstack@n-api.service[61677]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:40 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:18:40 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:18:40 user devstack@n-api.service[61677]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:18:40 user devstack@n-api.service[61677]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:40 user devstack@n-api.service[61677]: method: > Apr 13 18:18:40 user devstack@n-api.service[61677]: exception: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61677]: action_args: {'id': '19b65bfd-ef04-44fc-b5bf-f4742705b8b5'} Apr 13 18:18:40 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:18:40 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-e59b6c45-d375-4ead-8469-35854e9657f3 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5" status: 404 len: 111 microversion: 2.1 time: 0.033962 Apr 13 18:18:40 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 382/1143] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:18:40 2023] DELETE /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:18:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HTTP exception thrown: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Request method failure captured: Apr 13 18:18:40 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 HTTP/1.1 Apr 13 18:18:40 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:18:40 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:18:40 user devstack@n-api.service[61678]: Connection: close Apr 13 18:18:40 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:18:40 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:18:40 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:18:40 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:18:40 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEQsCbH-XONfEInZXOYlKkxH1Kr_NqyOFNx6r1h8ZgXhoud2F6YZPJF1yuiKuFk-GeK0qy0eHwdQWGfTJ7E0ifv0l38yLlTjmuvSFaNVuog7qgfZEWYB1gSYtfgCaPnPURteo7ZafX2e229Vt4OrYWqpsUOr7DMgYkHdwVorKFJqeL0 Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Project-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5bfb2b952aa4fd8a66d4eb5aa052e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Tenant: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Tenant-Id: c5bfb2b952aa4fd8a66d4eb5aa052e97 Apr 13 18:18:40 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1374126190 Apr 13 18:18:40 user devstack@n-api.service[61678]: X-User: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:40 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:18:40 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:18:40 user devstack@n-api.service[61678]: X-User-Id: 0ac81be2a2db40b2acbae911db8086ca Apr 13 18:18:40 user devstack@n-api.service[61678]: X-User-Name: tempest-AttachVolumeNegativeTest-1374126190-project-member Apr 13 18:18:40 user devstack@n-api.service[61678]: method: > Apr 13 18:18:40 user devstack@n-api.service[61678]: exception: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61678]: action_args: {'id': '19b65bfd-ef04-44fc-b5bf-f4742705b8b5'} Apr 13 18:18:40 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. Apr 13 18:18:40 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:18:40 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Returning 404 to user: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:18:40 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-c1e26013-572e-4609-9ef1-bc710596ef6c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5" status: 404 len: 111 microversion: 2.1 time: 0.031831 Apr 13 18:18:40 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 378/1144] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:18:40 2023] GET /compute/v2.1/servers/19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63fa3a6a-b611-44d6-8aeb-f6c512da4973", "device": "/dev/vdb"}} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=10 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:19:35 user devstack@n-api.service[61676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 18:19:35 user devstack@n-api.service[61676]: Thu Apr 13 18:19:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384/os-volume_attachments (ip 10.0.0.210) !!! Apr 13 18:19:35 user devstack@n-api.service[61676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 18:19:35 user devstack@n-api.service[61676]: Thu Apr 13 18:19:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384/os-volume_attachments (ip 10.0.0.210) !!! Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:19:35 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:19:36 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "POST /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292938 Apr 13 18:19:36 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 385/1145] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:19:35 2023] POST /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:20:02 user devstack@n-api.service[61677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 18:20:02 user devstack@n-api.service[61677]: Thu Apr 13 18:20:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384/os-volume_attachments/63fa3a6a-b611-44d6-8aeb-f6c512da4973 (ip 10.0.0.210) !!! Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=8 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=8 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:02 user devstack@n-api.service[61677]: DEBUG nova.objects.instance [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'services' on Instance uuid 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=61677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:20:02 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384/os-volume_attachments/63fa3a6a-b611-44d6-8aeb-f6c512da4973" status: 202 len: 0 microversion: 2.1 time: 0.192692 Apr 13 18:20:02 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 383/1146] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:20:02 2023] DELETE /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384/os-volume_attachments/63fa3a6a-b611-44d6-8aeb-f6c512da4973 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:20:02 user devstack@n-api.service[61678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c59d840-d572-48cd-8cb4-35f79e7327a6] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 18:20:02 user devstack@n-api.service[61678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 18:20:02 user devstack@n-api.service[61678]: Thu Apr 13 18:20:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384 (ip 10.0.0.210) !!! Apr 13 18:20:02 user devstack@n-api.service[61678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 18:20:02 user devstack@n-api.service[61678]: Thu Apr 13 18:20:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384 (ip 10.0.0.210) !!! Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:02 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Going to try to terminate instance {{(pid=61678) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:20:02 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384" status: 204 len: 0 microversion: 2.1 time: 0.146578 Apr 13 18:20:02 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 379/1147] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:20:02 2023] DELETE /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:02 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d3b6af7df4487a0e7113cdab7ee39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0d520107b4881bbd5a63f7033010d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:20:02 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0ee7b6cc-da13-4991-89c7-859407e45c16 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384" status: 200 len: 1549 microversion: 2.1 time: 0.174746 Apr 13 18:20:02 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 386/1148] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:20:02 2023] GET /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:20:04 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363170b9-0f09-4d89-9a9d-b1bb6756b384", "name": "network-vif-unplugged", "status": "completed", "tag": "b0c0f448-716a-403a-86fc-863bc8b62206"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:20:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:04 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] Creating event network-vif-unplugged:b0c0f448-716a-403a-86fc-863bc8b62206 for instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 on user Apr 13 18:20:04 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.190271 Apr 13 18:20:04 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 384/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:20:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:20:05 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-a64515f7-3fd1-4c81-a8ed-6e1206c093ad req-26a020d2-3a3f-4b9f-b9ae-8a0cb653b84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363170b9-0f09-4d89-9a9d-b1bb6756b384", "name": "network-vif-deleted", "tag": "b0c0f448-716a-403a-86fc-863bc8b62206"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:20:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a64515f7-3fd1-4c81-a8ed-6e1206c093ad req-26a020d2-3a3f-4b9f-b9ae-8a0cb653b84b service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a64515f7-3fd1-4c81-a8ed-6e1206c093ad req-26a020d2-3a3f-4b9f-b9ae-8a0cb653b84b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:05 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-a64515f7-3fd1-4c81-a8ed-6e1206c093ad req-26a020d2-3a3f-4b9f-b9ae-8a0cb653b84b service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-a64515f7-3fd1-4c81-a8ed-6e1206c093ad req-26a020d2-3a3f-4b9f-b9ae-8a0cb653b84b service nova] Creating event network-vif-deleted:b0c0f448-716a-403a-86fc-863bc8b62206 for instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 on user Apr 13 18:20:05 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-a64515f7-3fd1-4c81-a8ed-6e1206c093ad req-26a020d2-3a3f-4b9f-b9ae-8a0cb653b84b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 Apr 13 18:20:05 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 380/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:20:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:20:06 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363170b9-0f09-4d89-9a9d-b1bb6756b384", "name": "network-vif-plugged", "status": "completed", "tag": "b0c0f448-716a-403a-86fc-863bc8b62206"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:20:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:06 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:06 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] Creating event network-vif-plugged:b0c0f448-716a-403a-86fc-863bc8b62206 for instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 on user Apr 13 18:20:06 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030114 Apr 13 18:20:06 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 387/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:20:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=4 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:20:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.wsgi [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] HTTP exception thrown: Instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 could not be found. Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Request method failure captured: Apr 13 18:20:52 user devstack@n-api.service[61677]: request: GET /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384 HTTP/1.1 Apr 13 18:20:52 user devstack@n-api.service[61677]: Accept: application/json Apr 13 18:20:52 user devstack@n-api.service[61677]: Accept-Encoding: identity Apr 13 18:20:52 user devstack@n-api.service[61677]: Connection: close Apr 13 18:20:52 user devstack@n-api.service[61677]: Content-Length: 0 Apr 13 18:20:52 user devstack@n-api.service[61677]: Content-Type: application/json Apr 13 18:20:52 user devstack@n-api.service[61677]: Host: 10.0.0.210 Apr 13 18:20:52 user devstack@n-api.service[61677]: Openstack-System-Scope: None Apr 13 18:20:52 user devstack@n-api.service[61677]: User-Agent: python-urllib3/1.26.15 Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Auth-Token: gAAAAABkOEdE4gEmHw0Tb1M-LkX4MwZDbfgkQzkMkDQkbR9mINXhFo_GONDjwmwAIo1bR2zACFPYl2mzvZ1oLivAVdjEgtHz2ptNl7z8YDDKTlhOCwqlz8Vv1f4hCxA-lpX2hCikBWra7iZlpd5O7n-8oHjUsCj3qLRfE7c64W4FimUkyBoWgq4 Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Domain-Id: None Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Domain-Name: None Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Identity-Status: Confirmed Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Is-Admin-Project: True Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Project-Domain-Id: default Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Project-Domain-Name: Default Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Project-Id: 04e0d520107b4881bbd5a63f7033010d Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Project-Name: tempest-VolumesSnapshotTestJSON-970599831 Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Role: member,reader Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Roles: member,reader Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/04e0d520107b4881bbd5a63f7033010d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04e0d520107b4881bbd5a63f7033010d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04e0d520107b4881bbd5a63f7033010d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Tenant: tempest-VolumesSnapshotTestJSON-970599831 Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Tenant-Id: 04e0d520107b4881bbd5a63f7033010d Apr 13 18:20:52 user devstack@n-api.service[61677]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-970599831 Apr 13 18:20:52 user devstack@n-api.service[61677]: X-User: tempest-VolumesSnapshotTestJSON-970599831-project-member Apr 13 18:20:52 user devstack@n-api.service[61677]: X-User-Domain-Id: default Apr 13 18:20:52 user devstack@n-api.service[61677]: X-User-Domain-Name: Default Apr 13 18:20:52 user devstack@n-api.service[61677]: X-User-Id: 447d3b6af7df4487a0e7113cdab7ee39 Apr 13 18:20:52 user devstack@n-api.service[61677]: X-User-Name: tempest-VolumesSnapshotTestJSON-970599831-project-member Apr 13 18:20:52 user devstack@n-api.service[61677]: method: > Apr 13 18:20:52 user devstack@n-api.service[61677]: exception: Instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 could not be found. Apr 13 18:20:52 user devstack@n-api.service[61677]: action_args: {'id': '363170b9-0f09-4d89-9a9d-b1bb6756b384'} Apr 13 18:20:52 user devstack@n-api.service[61677]: {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 could not be found. Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 could not be found. Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 could not be found. Apr 13 18:20:52 user devstack@n-api.service[61677]: ERROR nova.api.openstack.wsgi Apr 13 18:20:52 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Returning 404 to user: Instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 could not be found. {{(pid=61677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:20:52 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-12949cf4-4df1-46a0-9506-e7eadab5d773 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384" status: 404 len: 111 microversion: 2.1 time: 0.035534 Apr 13 18:20:52 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 385/1152] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:20:52 2023] GET /compute/v2.1/servers/363170b9-0f09-4d89-9a9d-b1bb6756b384 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:21:01 user devstack@n-api.service[61678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c59d840-d572-48cd-8cb4-35f79e7327a6] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 18:21:01 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:21:01 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:21:01 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-568204729", "imageRef": "c7f9966b-afb1-42f9-9999-e623e0bf219a", "flavorRef": "42", "networks": [{"uuid": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0"}]}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:21:01 user devstack@n-api.service[61678]: DEBUG nova.network.neutron [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] validate_networks() for [('c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0', None, None, None, None, None)] {{(pid=61678) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flavor limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Image limits 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flavor pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Image pref 0:0:0 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Getting quotas for project 04e0d520107b4881bbd5a63f7033010d. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG nova.quota [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Getting quotas for user 447d3b6af7df4487a0e7113cdab7ee39 and project 04e0d520107b4881bbd5a63f7033010d. Resources: {'instances', 'ram', 'cores'} {{(pid=61678) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Going to run 1 instances... {{(pid=61678) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:21:02 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f9966b-afb1-42f9-9999-e623e0bf219a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:21:02 user devstack@n-api.service[61678]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c59d840-d572-48cd-8cb4-35f79e7327a6] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51958. Apr 13 18:21:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.055633 Apr 13 18:21:03 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 381/1153] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:21:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:21:03 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=4 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:21:03 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=8 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:21:03 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0b21464c-85bb-4a24-9aeb-369044ccac9d tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:21:03 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0b21464c-85bb-4a24-9aeb-369044ccac9d tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:21:03 user devstack@n-api.service[61676]: DEBUG nova.policy [None req-0b21464c-85bb-4a24-9aeb-369044ccac9d tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d3b6af7df4487a0e7113cdab7ee39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0d520107b4881bbd5a63f7033010d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61676) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:21:03 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0b21464c-85bb-4a24-9aeb-369044ccac9d tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff" status: 200 len: 1212 microversion: 2.1 time: 0.113928 Apr 13 18:21:03 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 388/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:21:02 2023] GET /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:21:05 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309a07e3-3f72-4bc9-a199-432d422570ff", "tag": "3f54d3e0-5d25-41a4-9302-0c9e782c8332"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:21:05 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:21:05 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:21:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:21:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:21:05 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:21:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] Creating event network-changed:3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance 309a07e3-3f72-4bc9-a199-432d422570ff on user Apr 13 18:21:05 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036096 Apr 13 18:21:05 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 386/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:21:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:21:07 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309a07e3-3f72-4bc9-a199-432d422570ff", "name": "network-vif-plugged", "status": "completed", "tag": "3f54d3e0-5d25-41a4-9302-0c9e782c8332"}]} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:21:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:21:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:21:07 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:21:07 user devstack@n-api.service[61678]: INFO nova.api.openstack.compute.server_external_events [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] Creating event network-vif-plugged:3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance 309a07e3-3f72-4bc9-a199-432d422570ff on user Apr 13 18:21:07 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029567 Apr 13 18:21:07 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 382/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:21:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:21:09 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309a07e3-3f72-4bc9-a199-432d422570ff", "name": "network-vif-plugged", "status": "completed", "tag": "3f54d3e0-5d25-41a4-9302-0c9e782c8332"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:21:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:21:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:21:09 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:21:09 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] Creating event network-vif-plugged:3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance 309a07e3-3f72-4bc9-a199-432d422570ff on user Apr 13 18:21:09 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029186 Apr 13 18:21:09 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 389/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:21:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:21:53 user devstack@n-api.service[61677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 18:21:53 user devstack@n-api.service[61677]: Thu Apr 13 18:21:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff (ip 10.0.0.210) !!! Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:21:53 user devstack@n-api.service[61677]: DEBUG nova.policy [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d3b6af7df4487a0e7113cdab7ee39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0d520107b4881bbd5a63f7033010d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61677) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:21:53 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-cc5a50e7-7fd5-4af9-a319-453b431f636f tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff" status: 200 len: 1496 microversion: 2.1 time: 0.159211 Apr 13 18:21:53 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 387/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:21:53 2023] GET /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff => generated 1496 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell0:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:22:53 user devstack@n-api.service[61678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 18:22:53 user devstack@n-api.service[61678]: Thu Apr 13 18:22:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff/os-volume_attachments (ip 10.0.0.210) !!! Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=4 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "024614e3-a5de-41f7-949b-e543fe681678", "device": "/dev/vdb"}} {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:22:53 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:22:53 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "POST /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540254 Apr 13 18:22:53 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 383/1159] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:22:53 2023] POST /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:23:12 user devstack@n-api.service[61676]: ERROR oslo.messaging._drivers.impl_rabbit [-] [be83b961-0d49-41d3-99b1-ebd82f5b4604] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell0:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_api:SELECT=6 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG dbcounter [-] [61676] Writing DB stats nova_cell1:SELECT=2 {{(pid=61676) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG nova.compute.api [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Fetching instance by UUID {{(pid=61676) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:23:12 user devstack@n-api.service[61676]: DEBUG nova.objects.instance [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'services' on Instance uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=61676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:23:12 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff/os-volume_attachments/024614e3-a5de-41f7-949b-e543fe681678" status: 202 len: 0 microversion: 2.1 time: 0.245525 Apr 13 18:23:12 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 390/1160] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:23:12 2023] DELETE /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff/os-volume_attachments/024614e3-a5de-41f7-949b-e543fe681678 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_api:SELECT=2 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG dbcounter [-] [61677] Writing DB stats nova_cell1:SELECT=6 {{(pid=61677) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Fetching instance by UUID {{(pid=61677) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:23:12 user devstack@n-api.service[61677]: DEBUG nova.compute.api [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Going to try to terminate instance {{(pid=61677) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:23:12 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff" status: 204 len: 0 microversion: 2.1 time: 0.131295 Apr 13 18:23:12 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 388/1161] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:23:12 2023] DELETE /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:23:12 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:23:13 user devstack@n-api.service[61678]: DEBUG nova.policy [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d3b6af7df4487a0e7113cdab7ee39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0d520107b4881bbd5a63f7033010d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61678) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:23:13 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-94db0d23-f843-43ec-be80-2b3c16d88fd5 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff" status: 200 len: 1548 microversion: 2.1 time: 0.157659 Apr 13 18:23:13 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 384/1162] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:23:12 2023] GET /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:23:14 user devstack@n-api.service[61676]: INFO oslo.messaging._drivers.impl_rabbit [-] [be83b961-0d49-41d3-99b1-ebd82f5b4604] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 52566. Apr 13 18:23:14 user devstack@n-api.service[61676]: DEBUG nova.api.openstack.wsgi [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309a07e3-3f72-4bc9-a199-432d422570ff", "name": "network-vif-unplugged", "status": "completed", "tag": "3f54d3e0-5d25-41a4-9302-0c9e782c8332"}]} {{(pid=61676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:23:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:23:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:23:14 user devstack@n-api.service[61676]: DEBUG oslo_concurrency.lockutils [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61676) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:23:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.compute.server_external_events [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] Creating event network-vif-unplugged:3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance 309a07e3-3f72-4bc9-a199-432d422570ff on user Apr 13 18:23:14 user devstack@n-api.service[61676]: INFO nova.api.openstack.requestlog [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092877 Apr 13 18:23:14 user devstack@n-api.service[61676]: [pid: 61676|app: 0|req: 391/1163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:23:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:23:16 user devstack@n-api.service[61677]: DEBUG nova.api.openstack.wsgi [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309a07e3-3f72-4bc9-a199-432d422570ff", "name": "network-vif-plugged", "status": "completed", "tag": "3f54d3e0-5d25-41a4-9302-0c9e782c8332"}, {"server_uuid": "309a07e3-3f72-4bc9-a199-432d422570ff", "name": "network-vif-deleted", "tag": "3f54d3e0-5d25-41a4-9302-0c9e782c8332"}]} {{(pid=61677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:23:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:23:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:23:16 user devstack@n-api.service[61677]: DEBUG oslo_concurrency.lockutils [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61677) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:23:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] Creating event network-vif-plugged:3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance 309a07e3-3f72-4bc9-a199-432d422570ff on user Apr 13 18:23:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.compute.server_external_events [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] Creating event network-vif-deleted:3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance 309a07e3-3f72-4bc9-a199-432d422570ff on user Apr 13 18:23:16 user devstack@n-api.service[61677]: INFO nova.api.openstack.requestlog [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029821 Apr 13 18:23:16 user devstack@n-api.service[61677]: [pid: 61677|app: 0|req: 389/1164] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:23:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Calling method '>' {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG nova.compute.api [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Fetching instance by UUID {{(pid=61678) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_api:SELECT=2 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG dbcounter [-] [61678] Writing DB stats nova_cell1:SELECT=6 {{(pid=61678) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:24:03 user devstack@n-api.service[61678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 18:24:03 user devstack@n-api.service[61678]: Thu Apr 13 18:24:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff (ip 10.0.0.210) !!! Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "8e058663-3c31-4a79-958e-63202e338bb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG oslo_concurrency.lockutils [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "8e058663-3c31-4a79-958e-63202e338bb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61678) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:24:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.wsgi [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] HTTP exception thrown: Instance 309a07e3-3f72-4bc9-a199-432d422570ff could not be found. Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Request method failure captured: Apr 13 18:24:03 user devstack@n-api.service[61678]: request: GET /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff HTTP/1.1 Apr 13 18:24:03 user devstack@n-api.service[61678]: Accept: application/json Apr 13 18:24:03 user devstack@n-api.service[61678]: Accept-Encoding: identity Apr 13 18:24:03 user devstack@n-api.service[61678]: Connection: close Apr 13 18:24:03 user devstack@n-api.service[61678]: Content-Length: 0 Apr 13 18:24:03 user devstack@n-api.service[61678]: Content-Type: application/json Apr 13 18:24:03 user devstack@n-api.service[61678]: Host: 10.0.0.210 Apr 13 18:24:03 user devstack@n-api.service[61678]: Openstack-System-Scope: None Apr 13 18:24:03 user devstack@n-api.service[61678]: User-Agent: python-urllib3/1.26.15 Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Auth-Token: gAAAAABkOEdE4gEmHw0Tb1M-LkX4MwZDbfgkQzkMkDQkbR9mINXhFo_GONDjwmwAIo1bR2zACFPYl2mzvZ1oLivAVdjEgtHz2ptNl7z8YDDKTlhOCwqlz8Vv1f4hCxA-lpX2hCikBWra7iZlpd5O7n-8oHjUsCj3qLRfE7c64W4FimUkyBoWgq4 Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Domain-Id: None Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Domain-Name: None Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Identity-Status: Confirmed Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Is-Admin-Project: True Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Project-Domain-Id: default Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Project-Domain-Name: Default Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Project-Id: 04e0d520107b4881bbd5a63f7033010d Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Project-Name: tempest-VolumesSnapshotTestJSON-970599831 Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Role: member,reader Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Roles: member,reader Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/04e0d520107b4881bbd5a63f7033010d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04e0d520107b4881bbd5a63f7033010d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04e0d520107b4881bbd5a63f7033010d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Tenant: tempest-VolumesSnapshotTestJSON-970599831 Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Tenant-Id: 04e0d520107b4881bbd5a63f7033010d Apr 13 18:24:03 user devstack@n-api.service[61678]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-970599831 Apr 13 18:24:03 user devstack@n-api.service[61678]: X-User: tempest-VolumesSnapshotTestJSON-970599831-project-member Apr 13 18:24:03 user devstack@n-api.service[61678]: X-User-Domain-Id: default Apr 13 18:24:03 user devstack@n-api.service[61678]: X-User-Domain-Name: Default Apr 13 18:24:03 user devstack@n-api.service[61678]: X-User-Id: 447d3b6af7df4487a0e7113cdab7ee39 Apr 13 18:24:03 user devstack@n-api.service[61678]: X-User-Name: tempest-VolumesSnapshotTestJSON-970599831-project-member Apr 13 18:24:03 user devstack@n-api.service[61678]: method: > Apr 13 18:24:03 user devstack@n-api.service[61678]: exception: Instance 309a07e3-3f72-4bc9-a199-432d422570ff could not be found. Apr 13 18:24:03 user devstack@n-api.service[61678]: action_args: {'id': '309a07e3-3f72-4bc9-a199-432d422570ff'} Apr 13 18:24:03 user devstack@n-api.service[61678]: {{(pid=61678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 309a07e3-3f72-4bc9-a199-432d422570ff could not be found. Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 309a07e3-3f72-4bc9-a199-432d422570ff could not be found. Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 309a07e3-3f72-4bc9-a199-432d422570ff could not be found. Apr 13 18:24:03 user devstack@n-api.service[61678]: ERROR nova.api.openstack.wsgi Apr 13 18:24:03 user devstack@n-api.service[61678]: DEBUG nova.api.openstack.wsgi [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Returning 404 to user: Instance 309a07e3-3f72-4bc9-a199-432d422570ff could not be found. {{(pid=61678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:24:03 user devstack@n-api.service[61678]: INFO nova.api.openstack.requestlog [None req-8d309799-c7a4-4747-a642-b743f89a2a21 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff" status: 404 len: 111 microversion: 2.1 time: 0.048294 Apr 13 18:24:03 user devstack@n-api.service[61678]: [pid: 61678|app: 0|req: 385/1165] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:24:03 2023] GET /compute/v2.1/servers/309a07e3-3f72-4bc9-a199-432d422570ff => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)